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PREFACE 


The Transportation Tomorrow Survey was a major travel survey 
conducted in the Fall of 1986, consisting of telephone 
interviews with a representative sample of over 61,000 
households in Metropolitan Toronto and the Regional 
Municipalities of Hamilton-Wentworth, Halton, Peel, York and 
Durham. The goal was to develop a reliable data base of 
household travel patterns for a typical weekday during the 


survey period. 


The project was undertaken and funded jointly by the Ontario 
Ministry of Transportation and Communications together with GO 
Transit, the Regional Municipalities of Hamilton-Wentworth, 
Halton, Peel, York and Durham, Metropolitan Toronto and the 


Toronto Transit Commission. 


This report documents the process leading up to the 
Transportation Tomorrow Survey, describes the conduct of the 
Survey and presents summary statistics about the survey 
process. Furthermore, this report contains the views of the 


participants on how future surveys can be improved. 


= Vow es 


 egieaue dich. a 


» 


ogi e lad 7 Tia =] 


bine Arey |, Teas yond te 
to seid: id seat 
itd pid wb edn i 
, ry By od Big 
; ty ay, 
cobans idk buy vel Wndot. & 
“ka. 4g Adee? road epg “hp 


4 J row te W053 Lagan ‘9. ust 7H 
tilt 6, sshquoT ere , 


ou 


ecia tae i et 
odd 4o Selo Brit ory'ne 
ures Ad ctr 
oA to ia ott ait 


ACKNOWLEDGEMENTS 


The Transportation Tomorrow Survey has been a product of 
team work and co-operation among the numerous agencies 
involved in transportation planning within the Greater 


Toronto Area. 


Nine agencies were represented on the main working 
committee which planned and conducted the Survey. The 
individuals who sat on the committee, not only absorbed 
the committee work into their normal workload, but also 
spent evenings and in some cases, weekends, making 
preparations for the survey, and assisting in the field 


work. 
The following people served on the working committee: 


Peter Dalton, Chairman Ministry of Transportation 
& Communications 


Scott Thompson 


V.C. Ma My i 

Tom Smith GO Transit 

Dave Ferguson Metropolitan Toronto 

Martin Seekings Metropolitan Toronto 

Mitch Stambler Toronto Transit Commission 

Dave Crowley Toronto Transit Commission 

Wayne Nicholl Toronto Transit Commission 

Ted Gill Regional Municipality of 
Hamilton-—Wentworth 

Andrew Head Regional Municipality of 
Hamilton-Wentworth 

Ho Wong Regional Municipality of Halton 

Dr. Ali Mekky Regional Municipality of Peel 

John Barnes Regional Municipality of York 

Jeff Mark Regional Municipality of Durham 


- vii - 


The coordinators of the subcommittees were as follows: 


Dr. Ali Mekky Household Survey Team 
Dave Ferguson ’ Finance and Cost Control Team 
Mitch Stambler/ Coding and Quality Control Team 
Dave Crowley 
Ho Wong Data Processing and Sample 
Control Team 
John Barnes Trip Diary Survey Team 
Martin Seekings - Data Validation Team 
Majorie Wallens Publicity and Public Relations 
Team 


A special mention should also be made of the many evenings 
put in by Dave Ferguson, Mitch Stambler and Scott Thompson 


to train interviewing staff. 


Apart from the working committee, important contributions 


to the Survey were made by the following: 


Rick Puccini, of the Ministry of Transportation and 
Communications, Chairman of the Toronto Area 
Transportation Planning Data Collection Steering 
Committee, gave the survey enthusiastic management support 
within the Ministry, thereby gaining for it the level of 
financing which it required and full participation by all 


agencies. 


Marjorie Wallens, of the T.T.C., with John Knight and Ann 
Marie Flack of her Public Affairs staff, together with 
Paul White of the Hamilton Street Railway and John Cooper 
of the Ministry of Transportation and Communications, 
prepared and implemented the survey publicity and public 


relations program. 


- vill - 


Barb Samson of Metropolitan Toronto, assisted by Claude 
Audette, processed the financial paperwork to ensure that 
the complicated cost sharing arrangement functioned 


smoothly. 


Jim Matsui, of the Environics Group, played a key role in 
the finalization of the survey design through his work on 


the conduct. of the Pilot Survey. 


Professor Gerry Steuart, of the University of Toronto 
Department of Civil Engineering, contributed to the 
assessment of survey methodology, particularly with 


respect to data entry technology. 


Rob Manherz of INFO 2000 Inc., developed the software for 
the innovative automated geocoding of geographic 


locational data. 


Henri Bessette, former Director of Planning for the 
Montreal Urban Community Transit Commission, provided the 
working committee with the benefit of Montreal's 


experience with origin-destination surveys. 


Phil Lamont of Lamont Advertising, designed the name and 
logo for the Survey, along with editing and rewriting of 


material for the public. 


Don Ambrose, Alastair Lynn, and the staff of Consumer 
Contact Limited, set up the field operations, carried out 


the telephone interviews and performed the data entry. 
Ian Fisher, who was retained by Consumer Contact Limited 


in the capacity of Chief Supervisor, directed the 


day-to-day operation of the telephone interviewing. 


= 


Mike Wehkind, Assistant to the General Manager, who grew 
into a job which started with day-to-day administrative 
matters, but came to include Lesponsipility Lor the 
complete geocoding operation. 


Toivo Rukholm 
Tranplan Associates 
Survey General Manager 


EXECUTIVE SUMMARY 


INTRODUCTION AND BACKGROUND 


The Transportation Tomorrow Survey was a major travel 
survey conducted from September until December 1986. 
It consisted of telephone interviews with over 61,000 
households in Metropolitan Toronto and the Regional 
Municipalities of Hamilton-Wentworth, Halton, Peel, 
York, and Durham (see Exhibit 1.1, Study Area). 


The project was undertaken and funded jointly by the 
Ontario Ministry of Transportation and Communications 
(together with GO Transit) and the six regional 
municipalities inside the study area. In Metropolitan 
Toronto, participation was split between the Metro 
Planning Department and the Toronto Transit 


Commission. 


The last comprehensive area-wide travel survey in the 
Greater Toronto Area was conducted in 1964 (MTARTS 
Origin-Destination Survey - see Table 1.1). Since 
1977, the major public agencies involved with 
transportation planning in the GTA have been meeting 
regularly as the Toronto Area Transportation Planning 
Data Collection Steering Committee (TATPDCSC) to 
coordinate data collection efforts. -_In,1985, the 
TATPDCSC began planning for a major survey to coincide 


with the mid-term Census in 1986. 


PLANNING, DESIGNING, AND ORGANIZING THE SURVEY 


The overall organization structure of the survey is 
shown in Exhibit 2.1. The structure reflects the 
cooperation and team work on the part of the nine 
transportation planning agencies in order to carry out 


the’ survey. 
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EVENTS IN THE CONDUCT OF THE SURVEY 


LS Elbe 


May 1985 


Sept s— UCi oo 


Aug. 85 - 
Jan. 86 


March 86 


April 86 


April 86 


May-June 86 


June 86 


June 27, 86 


Sept. 86 


Sept. 16 - 
Dec. 137, 7°86 


Sept. 86 - 
Feb. 87 


OCt. no Oe 
April 87 


Formation of the Toronto Area 
Transportation Planning Data Collection 
Steering Committee 


Provincial approval ingprinciple to fund 
survey 


Approval in principle of commitment to the 
survey by Metro and six Regions 


Design of Pilot Survey; selection of 
ConLractorm toecarryeouteurs OL. oulVvev 


Pilot Survey telephone interviews 
Appointment of Survey General Manager 
Review of findings 


Report on Pilot Survey. 


Contact made with potential contractors to 
conduct telephone interviewing for main 
survey. 


National Census 


Contractor selected to conduct interviewing 
and data entry 


Press Conference held in each Region with 
Regional Chairman as key spokesman; Metro 
Toronto news conference with Metro Chairman 
and Minister of Transportation and 
Communications. 


Telephone interviews with 61,708 
households 


Data entry and error checking 


Geocoding of origin/destination information 
and transit route data 
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The preparations for the survey were carried out 
through special subcommittees (teams) of the TATPDCSC 
Work Group. Each team was headed by a Team 


Coordinator who reported to the Main Work Group. 


The Publicity and Public Relations Team designed and 


carried out the publicity program. 


The Finance and Cost Control Team designed and oversaw 


the cost control systems. 


The Data Validation Team assembled data and made 
preparations for the expansion and validation of the 


survey data. 


The Household Survey Team designed and oversaw the 


conduct of the telephone survey. 


The Coding and Quality Control Team designed part of 
the interviewer training program and management 


reports on productivity and quality. 


The Data Processing and Sample Control Team designed 


the sample and the data processing system. 


The Trip Diary Survey Team designed and oversaw the 


conduct of a separate more detailed mail-back survey. 
TELEPHONE INTERVIEWING 


The survey interviews were conducted by telephone 
between September 16 and December 13, 1986. Through a 
competitive bidding process, (see Section 2.5) a 
marketing research firm was retained to do the 
telephone interviewing along with data entry and 


related tasks. 


A sample of households (names, addresses and telephone 
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TELEPHONE INTERVIEWING STATISTICS 


*72 telephones in total were used to conduct the survey. 


60 telephones 
Durham, York, 


12 telephones 
Wentworth and 


in Toronto covering Toronto, 
and Peel 


in Hamilton covering Hamilton- 
Halton 


*3.5 interviews completed by each interviewer each hour 


*Up to 5 attempts made to contact each household 


50.7% 
PAS OR 3 
12.2% 
6.3% 
5.6% 


*Sample Usage 


of 
on 
of 
of 
OL 


interviews 
interviews 
interviews 
interviews 


interviews 


Total Sample Used 
Refusal Rate 


Response Rate 


Completion Rate 


Metropolitan Toronto 


Peel 


Hamilton-Wentworth 


York 
Durham 


Halton 


Unknown/external 


TOTAL 


completed on lst call 
completed on 2nd call 
completed on 3rd call 
completed on 4th call 
completed on 5th call 


102,606 
Pee), 5 
73.7% 
60.1% 


No. of Completed % of all 
Interviews(Households) Households 


34,398 4.0% 
7,661 4.2% 
6,549 4.1% 
4,628 4.6% 
4,388 4.1% 
4,050 4.5% 

34 0.1% 

61,708 4.1% 
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numbers) was purchased from Bell Canada (see 

Section 2.4.4). An advance letter signed by the 
Regional Chairman and the Minister of Transportation 
and Communications (see Exhibit 2.4) was mailed to all 


households prior to telephone contact. 


Interviewing was conducted from Toronto (60 
telephones) and Hamilton (12 telephones) with the 
Hamilton-Wentworth and Halton Regions being called 
from Hamilton while the rest of the study area was 
called from Toronto. Up to five attempts were made to 
reach a household; a busy signal did not count as an 
attempt and attempts had to be at least 2.5 hours 


apart. 


The interviewer followed a set script (see Exhibit 

2 Dut ind OLdertO.aLlow amatural flow, 
interviewers were encouraged to use the script as a 
guide, not as a rigid formula. Calls were monitored 
on a random sample basis by Supervisors and by members 
of the TATPDCSC. The interviewers recorded their 
responses on a coding form (see Exhibit 2.3) which, 
after being scheduled by a supervisor, was forwarded 


to data entry. 


DATA ENTRY, CODING, AND EDITING 


Data entry was accompanied by automated error checking 
(range checks and logic checks) with errors being 
referred back for correction (see Exhibit 4.1) for an 
overall flow chart of the process). Accepted records 
were forwarded to a team of TATPDCSC personnel for 
coding the addresses of all origins and destinations 


in the trip records. 
Coding of address data was accomplished using a new 


automated process developed specifically for the 


Transportation Tomorrow Survey. The microcomputer 


= Sa 


based system used Statistics Canada Area Master Files 
to look up and assign unique XY coordinates to each 
address. While the coordinate systems (UTM) is 
capable of locating any point on earth to within one 
metre, the Area Master Files assign addresses to the 


centre of the respective blockface. 


The geocoding software was developed with the 
capability of dealing with intersections and monuments 
(e.g. CN Tower) as well as detailed street addresses. 
The survey respondents reported their trip ends in the 


following proportions: 


Detailed address 52% 
Monuments 30% 
Intersections 18% 


The system had the ability to "learn" as monuments 
were added to the monument file and as alias names 
(e.g. common misspellings) were entered into the 


system. The success rate varied by the type of 


address: 
Monuments 373 
Intersections 60% 
Street Addresses (not a home address) 45% 
Home Address 76% 


SURVEY COSTS 


For planning purposes the budget for the survey field 
work was set at $800,000 plus contributions of 
services, supplies, and manpower from the 
participating agencies. In addition to the above, the 
Ministry of Transportation and Communications also 


agreed to fund the total cost of a Pilot Survey. 


The actual costs for the household telephone interview 
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FINANCIAL SUMMARY 


Source of Funds 


1. Funded through cost sharing 
agreement 


Province 
Regions 


2. Special funding from Province 


for Pilot Survey and Trip 
Diary 


3. Supplies, services, and man- 
power provided by partici- 
pating agencies 


TOTAL: 


Summary of Expenditures 


Ms Administration 
2 Pilot Survey 
ar Telephone Interviews 
4. Geocoding 
oh Other 
6. Tri paliasy 
TOTAL: 
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$627,000 
200,000 


$88,000 
37,000 
501,000 
301,000 
65,000 


51,000 


$1,043,000 


$827,000 


86,000 


130,000 


$1,043,000 


survey were $825,000, plus the supplies, services, and 
manpower provided by individual agencies estimated to 
be worth approximately $130,000. The Ministry of 
Transportation provided additional funding for the 
Pilot Survey @($ 37,000) ®andmthemIi1'p epad wyesur vey 
(approximately $50,000). 


The telephone survey cost approximately $16 per 
completed household. These costs do not include 
subsequent costs for processing and analysing the 
data. 


CONCLUSIONS AND RECOMMENDATIONS 


Some of the conclusions and recommendations about the 
Survey must be considered preliminary or tentative 
because only in-depth analysis of the tabulations of 
the survey responses will show how well the survey 


process achieved its goals. 


6.1 Telephone Surveys 
Telephone interviews are a cost effective method 
of collecting household travel information, 
although the quality of response remains to be 


proven. 


6.2 Sample 
Bell's telephone listings anpears to be a good 
source for drawing the sample for a travel 
survey. However, it is recommended that in 
future more emphasis be placed on the design and 


control of the sample. 


6.3 Direct Data Entry 
It is recommended that any future survey give 
serious consideration to using direct data entry. 
Furthermore, it is recommended that the direct 
data entry system consist of a full screen 


representation of the entire questionnaire with 
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full screen editing capabilities, as opposed to 
the CATI systems used by market research firms. 
The CATI approach, a page by page system, is 
tailored to the highly structured interviews 
common to marketing research surveys; this 
approach is unsuited to travel surveys where it 
is important for the interviewer to get an 
overall understanding of the household's activity 
pattern and to probe for trips which the 


respondent may have forgotten to mention. 


Marketing Research Industry 

It 1s recommended that future surveys not 
necessarily rely on the market research industry 
to carry out the field work. Equal consideration 
should be given to some of the other 


possibilities described in Section 6.6. 


Quality of Telephone Interviewing Staff 

The contractor had difficulty attracting enough 
capable interviewers to staff the 72 telephones. 
It is felt that the low interviewer wage rate 
affected the number and the quality of the people 


available to do the work. 


It is recommended that an interviewer hourly wage 
rate be established at the outset when preparing 
for any future surveys. This rate would be paid 
to interviewers whether the survey is done in- 
house or by an outside contractor. This will 
require some research and analysis in the labour 
market place. The established rate should be 
Significantly higher than the prevailing 
marketing research interviewer rates, possibly 
50% higher. 


Contract Out vs. In-House 


Starting with the wage rate established as per 
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the recommendation in Section 6.5, it is 
recommended that the following options be 


explored: 


i) Conduct the survey totally in-house. 
Professional and technical staff would have 
to be assigned to the project from within 
the agencies to direct and manage the 
preparations and the implementation of the 
Survey. One of the agencies would have to 
assume a lead role in terms of being the 
hiring and payroll agency for temporary 
stati. 

ii) Conduct the survey in-house, but use outside 
firms to perform specific services. For 
example, an “office overload" type of firm 
might be engaged to recruit interviewers who 
would nominally stay on the payroll of the 
recruiting company which would bill monthly 
on a cost plus basis. 

iii) Use a contractor/consultant in a similar 


capacity as in 1986. 


Geocoding 

The geocoding system proved itself to be cost 
effective compared to manual coding to traffic 
zones, while providing a better quality product 


in terms of precision and future flexibility. 


It is recommended that the geocoding system 
continue to be developed and enhanced with a view 
to improving its performance while reducing 
costs. Improvements would include changes to 
permit use of the system on industry standard 
microcomputers, and greater emphasis on the 


following in training interviewers: 


i) 


uhh )) 


Di) 


Use of monuments in describing trip ends. 
Use of well defined recording conventions 
for addresses, monuments and intersections. 
Most major telephone travel surveys have 
been content with making three attempts to 
contact each household. The Transportation 
Tomorrow Survey required five attempts; 

the fourth and fifth attempts were 
responsible for approximately 12% of the 
final total of completed interviews.. The 
merits of retaining the fourth and fifth 
attempts in future surveys will need to be 
assessed from a detailed analysis of the 
data produced by these additional attempts. 
The initial reaction, however, would be to 
recommend retaining the five attempts, 
except if it can be shown that these 
attempts make no significant contribution 


to the quality of the final data base. 
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1. 


INTRODUCTION AND BACKGROUND 


The last comprehensive area-wide travel survey in the 
Greater Toronto Area was conducted in 1964 (see MTARTS 
in Table 1.1). Between 1964 and 1976 there was very 
little activity in the area of travel data collection 
in the Toronto area. aalielo iw; alter aistudysot 
transportation data needs, the major public agencies 
involved with transportation planning began to meet 
regularly to exchange information and to coordinate 
data collection efforts. This group became known as 
the Toronto Area Transportation Planning Data 
Collection Steering Committee (TATPDCSC). Membership 
included Metropolitan Toronto, the Toronto Transit 
Commission, the Regional Municipalities of Durham, 
York, Peel, Halton, and Hamilton-Wentworth, the Ontario 
Ministry of Transportation and Communications and GO 


Transat. 


Unable to agree on an overall survey approach, 
individual agencies proceeded with household and 
employee travel surveys during the 1977 to 1982 period 
(see Table 1.1). The TATPDCSC served as a forum for 
coordinating these data collection activities and 
sharing the results. However, the limitations of these 
surveys served to highlight the benefits which could be 


gained from a common comprehensive area-wide approach. 


The experience of the Montreal Urban Community Transit 
Commission (MUCTC) with origin-destination surveys in 
1970, 1974, 1978 and 1982 demonstrated that reliable 
region-wide planning data could be produced at a very 
reasonable cost (see Table 1.2). A similar area-wide 
survey in the Greater Toronto Area appeared to have the 
potential for reducing overall data collection costs 
while improving the quality of available data. This 


information from Montreal served as a catalyst to 
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TABLE 1.2 


RECENT MAJOR SURVEYS ELSEWHERE IN NORTH AMERICA 


tanh yia'd 


Montreal 


Vancouver 


Houston, 
Denver, - 
Minneapolis - 
St. Paul, and 
others 


YEAR 


1970 
1974 
LOS 
1982 


L935 


1980's 


DESCRIPTION 


Telephone interviews with 4-5% of 
households from telephone listings; 
origin/destination data coded manually to 
1400 zones; 

results validated by comparing survey 
estimates with actual observed ridership 
counts; 

Survey conducted in-house; 

low cost, approximately $10-12 per 
household in 1982 


Telephone interviews with 5% of households 
using Montreal methodology; 
origin/destination data geocoded to block 
face level using a digitizer; 

survey field work contracted out; 
relatively low cost, approximately $20 per 
household 


Small sample size (under 1%); 

initial contact by telephone to solicit 
participation; 

mailout of appropriate number of survey 
forms; 

travel data collected over telephone, or 
by mail; 

high cost, $75-125 per household 


accelerate activity by the TATPDCSC towards implementing 
a comprehensive origin-destination survey. Recognizing 
the importance of the Census as a source of supporting 
data, the TATPDCSC began working towards an area-wide 
travel survey to coincide with the midterm Census in 
1986, with a view to possibly repeating the survey every 


five years in step with the Census. 


Preliminary planning for the survey began in 1985 as the 
agencies prepared their 1986 budget requests (based on 
early cost estimates and assumptions on the level of 
funding that the Ministry of Transportation and 
Communications would provide). Special Ministry funding 
allowed preparations to proceed in late 1985 and early 
1986, while municipal councils considered their 1986 
Budget Estimates. Eventually all agencies approved 


funding for the survey. 
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2. PLANNING, DESIGNING, AND ORGANIZING THE SURVEY 


Pade 


Survey Organization Structure 


The Toronto Area fransportation Planning@pata 
Collection Steering Committee (TATPDCSC) formed a 
Survey Management Team (the Survey Work Group) to 
manage the Survey. The Survey Work Group 
included at least one person from each of the 
nine participating organizations (the Regional 
Municipalities of Peel, York, Halton, Hamilton- 
Wentworth and Durham, Metropolitan Toronto, 
Ministry of Transportation and Communications, 


GO Transit, and. the Tononto Wrang re Commission ). 


Exhibit 2.1 shows the overall organization 


structure reporting to the TATPDCSC. 


The Survey Work Group engaged a General Manager 
with an Assistant to carry out the day-to-day 
management of the project. Each major element of 
the survey was assigned to a subcommittee of the 
Survey Work Group. Coordinators of each sub- 
committee, or team, reported the progress of 
their team to the Work Group. Major issues, such 
as Contractor selection, sample size, 
questionnaire content and plans for the Pilot 


Survey were also debated by the Work Group. 


The Publicity Team was formed to plan and design 
the program of survey publicity and recommend and 
carryoutya public’relations program for the 


project. 


The Finance and Cost Control Team planned and 


designed the cash flow and cost control systems. 
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The Data Validation Team planned and designed the 
survey data expansion and validation methodology. 
The group assembled traffic counts, Census data, 
and other sources of empirical data required for 
comparison to the survey data. Other duties 
included the determination of any biases in 
survey data and the development and validation of 


an expansion procedure. 


The Household Survey Team designed and oversaw 
the main Household Telephone Interview Survey. 


Specific duties of this group included the 


following: 


(a) Making logistical arrangements for the 
conduct of the survey, including 
investigation of a site for the survey in 


case the survey was done in-house; 


(b) Recommending to the Work Group whether the 
survey should be done in-house or by a 
contractor and defining the terms of 


reference for the contractor; 


(re) Recommending to the Work Group the survey 
interviewing method including an 
investigation of trip/activity recall 
frameworks and proxy versus non-proxy 
interviewing. In addition, policies 
relating to call-backs and answering 


machines were established; 
(d) Finalization of the questionnaire; 
(e) Recommending to the Work Group a short list 


of contractors to conduct the Household 


Survey. 


The Coding and Quality Control Team was 


responsible for a part of the interviewer 
training program, determining management 
information statistics to monitor the 
productivity of interviewers and of the quality 


of the completed interviews. 


The Data Processing and Sample Control Team was 


responsible for obtaining the sample from Bell 
Canada, and for ensuring that the software for 


edit checks and geocoding was developed. 


The Trip Diary Survey Team was responsible for 


administering a separate more detailed mail-back 
survey of about 5,000 households from.a 
stratified sample of previous respondents. The 
team was responsible for the design of the 
questionnaire sample selection and the conduct of 


the survey. 


Metropolitan Toronto agreed to assume the role of 
contracting agent for services and to pay the 
bills as they were presented. To do so, Metro 
entered into legal agreements with each of the 
regional municipalities and the T.T.C. to ensure 
that there was a binding commitment to reimburse 
Metropolitan Toronto for their pro rata share of 
gross costs. Each municipal agency subsequently 
applied to the Ministry of Transportation and 
Communications for a 75% subsidy on their portion 
of the total costs. For details on survey costs, 


see Section 5 Survey Costs. 


The original organization structure was developed 
with sufficient flexibility to accommodate an in- 
house operation as well as a situation whereby an 


outside contractor could be employed to carry out 


some or most of the field work, (e.g. the 
printing and mailing of advance letters, the 
telephone interviewing, data editing and data 


entry). 
Selection of Survey Methodology 


The initial selection of survey methodology dealt 
with such considerations as interviewing 
technique (telephone vs. mail) and sampling 
technique (size, stratification, etc.). The 
impressive results achieved by Montreal in terms 
of data quality and cost effectiveness, played a 


major role in the decision on survey methodology. 


The merits of various survey techniques, 
including "mail out, mail back" surveys, were 
explored by the Work Group, with the Montreal 
style telephone interview technique being 
favoured by the Group as a whole. In terms of 
the sample, there was some thought given to 
interviewing a small sample at greater depth, but 
a larger sample approach, along the lines of 


Montreal, was selected. 
; 1 
Pilot Survey 


The Ministry of Transportation and Communications 
retained the Environics Research Group Limited to 
Carry out a nine day Pilot Survey of the 
household telephone survey during March, 1986. 


The objectives wereetor testa, drate 


1 For full details on the Pilot Survey refer toa 
report entitled "M.T.C. Origin-Destination Survey, 
Pilot Study" dated April 1986 prepared by the 
Environics Research Group Limited. Appendix A of 
this document contains some of the key exhibits from 
the report prepared by the Environics Group. 
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questionnaire, test the sample procedure, test 
the effectiveness of an advance letter, assess 
completion rates and refusal rates, and evaluate 
methods of data entry. It should be noted that 
interviewer productivity was not emphasized as an 
objective of the Pilot Survey, and no particular 


effort was made to enhance productivity. 


Sample households were mailed an advance letter 
Signed by the Deputy Minister of Transportation 
and Communications (see Appendix A). Some of the 
households received a 'trip log! with their 
letter; the trip log is a form for keeping track 
of trips made on the specified survey day (only 
these households knew their survey day in 


advance). 


Environics used 19 interviewers and 4 supervisors 
for the two week pilot. All training was done by 
Environics. The traditional paper and pencil 
method was used to record data by staff working 
in Environics' 14 line main telephone facility in 
downtown Toronto. However, four of the better 
interviewers were assigned to work on telephones 
in Environics administrative office area using 
microcomputers to enter data directly during the 
interview. The software for the testing of the 
direct data entry method was developed by 
Professor Gerry Steuart of the University of 


LOGOnRCeOr 


A total of 1482 interviews were completed during 
the nine day survey period. Of these, 470 were 
conducted using direct data entry and 1,012 were 
completed by traditional pencil and paper 


methods. The major findings were the following: 


so 


i) 
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Interviews were completed with 71% of the 
original list of telephone numbers and 82% 
of the numbers deemed to be ‘'eligible'; 
The refusal rate was 15%; the advance 
letter appeared to help keep refusals to a 
moderate level; 

The average time for a household interview 
was nine minutes, compared to six minutes 
in Montreal; 

The average number of trips per person was 
23 

The trip log appeared to have a significant 
beneficial effect on reducing average 
interview times, while improving trip 
recall (more trips reported); 

The productivity of the interviewers 
(approximately 2.5 interviews per hour per 
interviewer) was much lower than in 
Montreal (6 interviews per hour per 
interviewer), but it was still rising as 
the Pilot came to an end; 

Productivity rates for the interviewers 
using Direct Data Entry were significantly 
higher than for the others, reaching almost 
four interviews per hour per interviewer; 
Considering the learning curve (Montreal 
experience indicated three weeks before 
full production), the results of the Pilot 
Survey suggested that at least four 
interviews per hour per interviewer should 
be achievable, with 4.5 or even higher 
being quite possible; 

The cost per completed interview was $25, 
compared to the original estimate of $14 
(based on Montreal experience and allowing 
for inflation). The higher cost was due to 


the lower level of interviewer 


alee 


productivity. Since productivity was not 
emphasized during the Pilot, it appeared 
reasonable to assume that it could be 
improved, thereby reducing costs; 

(x) Supervisors spent an average of five 
minutes per form checking it for 
completeness and consistency. Automation 


would help. 


In summary, the Pilot Survey confirmed that the 
Montreal methodology could be applied in Toronto 
with similar results in terms of such factors as 
completion rates. The results also suggested 
that at least four interviews per hour per 
interviewer should be attainable in Toronto 
resulting in costs similar to the Montreal 


levels. 


Finalization of Survey Design 

After establishing an organization structure and 
carrying out a Pilot Survey, the Survey Work 
Group entered into a period of intense activity 
to finalize all aspects of the implementation of 
the telephone survey. With the benefit of the 
experience from the Pilot Survey, informed 
analysis and discussion preceded decisions on 
fundamental issues, such as whether to use 
outside contractor(s), interviewing methods and 
Standards, interviewer script, the advance 
letter, sample selection, and whether to use 
direct data entry. This section of the report 
documents the decisions which were taken in 


finalizing the design of the Survey. 


73). 


2.4.1 Interviewing Standards 


In finalizing the telephone interview 
standards, the Household Survey Team and 
the Work Group as a whole dealt with such 
issues as the number of call-backs, 
answering machines, proxy respondents, and 


defining which trips were of interest. 


Ideally, the interviewer would directly 
question each individual in the household 
about their trips, but the time required to 
do this would significantly increase costs. 
Alternatively, one member of the household 
could be questioned about the trips made by 
all members of the household, but the 
quality of the trip information could be 
expected to suffer. The survey team 
elected to accept proxy interviewing with 
any adult member of the household on the 
understanding that, wherever possible, the 
respondent would be encouraged to ask other 
members of the household particulars on 
their trips, or to get them on the phone, 
if available. In cases where the 
respondent was unfamiliar with another 
household member's tripmaking, that member 
was to be interviewed personally. If the 
other person was unavailable, a call-back 


was to be arranged. 


It was decided that five attempts would be 
made to contact each household. A busy 
Signal would not count as an attempt. Trip 
information collected during a call-back 
situation was for the day before the call- 


back or on a Friday if the call-back was 


ee 


made on a Monday. An exception to this 
occurred when partial information had 
already been collected for a respondent 
during the initial interview. In this 
case, the individual's trips would be 
completed for the same day as the rest of 
the household. 


If the interviewer encountered a telephone 
answering machine, three call-back attempts 
were to be made. On each attempt, the 
interviewer would leave a message including 
a toll free telephone number for the 


respondent to call. 


Netailed policies were formulated on which 
trips should be recorded, and what 
information should be collected about 
certain trips. As a general rule, all 
trips by all household members over five 
years of age were to be recorded. Trips 
would be recorded for the 24 hour period 
between 4:00 AM the previous weekday and 
4:00 AM on the day of the interview. 
However, several exceptions were 
identified. In the case of walk and 
bicycle trips, only those trips between 
home and school and home and work were 
deemed important enough to record. In 
addition, the regular travel times of 
children (13 and under) were not recorded 


for security reasons. 


Trips seen as incidental to the primary 

trip purpose were not recorded as separate 
trips. A person stopping off at a doughnut 
shop to pick up a coffee on his way to work 


= Gyo 


is an example of this. However, if the 
person stopped for breakfast, then the trip 
from home to the restaurant and from the 
restaurant to work, would be coded as two 
separate trips. Discretion on the part of 
the interviewer was required in 
distinguishing between a stopover anda 


legitimate trip. 


For a respondent involved in an occupation 
which required driving to many places in 
one day, only the first and last work trips 
were recorded. Those involved in police 
work, bus drivers, taxi drivers and truck 


drivers are all included in this category. 
Survey Questionnaire/Script 


The script developed for the Pilot Survey 
was modified for the main survey. The 
Household Survey Team, the main Work Group 
and the telephone survey contractor all 
participated in the finalization of the 
script and the development of the coding 


form. 


The script used in the main survey is shown 
as Exhibit 2.2, while the coding form is 


shown as Exhibit 2.3. 


The script was subsequently translated into 
Italian, Portuguese, Spanish, German, 
Greek, Cantonese, French, Polish and 
Ukranian. TATPDCSC members identified 
staff in their agencies or in local area 
municipalities who had sufficient 


transportation planning background and 
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TELEPHONE INTERVIEW SCRIPT 


"Hello, my name is calling for the 
Transportation Tomorrow Survey. Is this the 
household at ie 


change or correct address if necessary. 
If business, verify phone number and ask if residence. 


"By now, you should have received a letter explaining the 
purpose of this Provincial and Regional Government survey on 
travel patterns, and telling you to expect my call. I would 
like to proceed with the interview now if it is convenient. 
Everything I ask you will be strictly confidential." 


answer questions or arrange call-back if respondent is 
unable to provide travel information. 


"First, I'd like to ask you some background questions about 
your household." 


13s 


14. 


"Do you live in an house or an apartment?" 

"How many people normally live in your household?" 
"How many motor vehicles such as cars, trucks, or 
motorcycles do the members of your household have for 
their personal use?" 

"How old are you (he/she)?" Record sex 

"Do you (she/she) have a driver's licence?" 

"Are you (he/she) employed?" 


(Yes) - At home or outside? 
Full-time or part-time? 
(No) - Are you (he/she) a student (other)? 
OK este a! « the next person in the household. Who would 
that he?" 


"Now I would like to ask you about the trips that you 
(and the other members of your household) made yesterday 
(OreFriday)® 
"On your (his/her) first trip, did you (he/she) leave 
from home?" 
If not "From where?" 
"Where did you (he/she) go? 
“Did youtgoldirectly to or did you stop on the 
way?" 
if stop was for a primary trip purpose, make the 
stop a destination, and record the travel from that 
stop to the next destination as another separate 
trip (if intersection, record specific corner) 


"Where is that?" 
"What town/city/community is that in?" 
"How did you (he/she) get there?" 
if transit, ask for route(s)/operator(s) 


"What time did you (he/she) begin that trip?" 
"What was the purpose of that trip? 
if not already evident 


"Where did you (he/she) go next?" 
remember to probe for trips during day and after 
last recorded trip 


"Now I'd like to ask you about (the next person's) trips 
yesterday.? 


"THANK YOU FOR YOUR CO-OPERATION" 


———— 
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knowledge of the specified languages to be 
able to produce a good technical 
translation. The survey contractor was 
required to hire at least one person who 
was sufficiently fluent in each of the 
specified languages to be able to conduct 


an interview using the translated script. 
Advance Letter/Trip Log 


The purpose of the advance letter was to 
introduce the survey, outline the process, 
inform the household to expect a telephone 
call during the next few evenings (or 
during the day on Saturdays) at the 
specified times and to impress on the 
household the legitimacy and importance of 
the interview. It was signed by both the 
Minister of Transportation and 
Communications and the Chairman of the 
Region in which the household was located. 
The letter is shown in Exhibit 2.4 in its 


final Jrort. 


The Pilot Survey concluded that the trip 
log shown in Appendix A had a major impact 
on respondent recall, increasing the number 
of trips reported and reducing the time 
required to report them. While the 
inclusion of the same type of trip log in 
the main survey was highly desirable, the 
logistics involved with scheduling trip 
days and interview calls on a large scale 


precluded its implementation. 


Since the Pilot Survey showed that there 


appeared to be a benefit even if the person 
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ADVANCE LETTER 


RANSPORTATION 
Sune! 


H. Resident 

10 New Street 
Anytown, Ontario 
Z9Z Q1Q 


To improve roads and transit services, we are conducting a special and very 
important survey. The purpose: collect information on your travel habits. 


We're asking for your help. 


The survey process is interesting. You'll be telephoned at home and asked 
to spend about seven minutes answering questions by a professional 
interviewer from Consumer Contact Ltd. The interviewer will call in the 
next few days. On week nights, the time will be between 5:00 p.m. and 9:45 
pem. If the interviewer calls on a Saturday, it'll be between 10:00 a.m. 
ands 52008 om: 


Most of the questions will be about your household travel on the day before 
the call. We'd like to know about where and when trips were taken so we 
can get an accurate picture to tell us how to plan improved transportation 
services and facilities. In addition, we'll be asking the usual questions 
about age, employment, household Size, etc. 


Enclosed, you will find examples of the types of travel questions we will 
be asking you about each member of the household 6 years of age and over. 


All information will be kept Strictly confidential. No information will be 
released in such a way that it could be traced to an individual household. 
However, the combined figures from all the interviews should shed new Taght 
on what's needed in the future. 


If you have any questions, please call the Public and Safety Information 
Branch of the Ministry of. Transportation and Communications in Toronto at 
239-3901 or toll “free 1-800-268-0637 between 8:30 a.m. and 4:30 p.m. 


We'd like to extend our personal thanks for your assistance in this 
project. Your help means better roads and better transitwin the future, 


Yours sincerely 


Gary Herrema Ed Fulton 

Chairman Minister of 

The Regional Transportation and 

Municipality of Communications 
Attachment Durham 


A survey conducted for: 
the Regions of Durham, Halton, Hamitton-Wentworth, Peel and York; 
Metropolitan Toronto, Ministry of Transportation and Communications, 


: GO Transit and the Toronto Transit Commission. 
Ontario 


had not recorded his’ trips” in’ the trip log, 
it was hypothesized that having a clear 
visual picture of what the interviewer was 
going to ask, helped people prepare for the 
questions. Accordingly, the decision was 
made to include a trip log with the advance 
letter in =the. form ot an example orecne 
type of data which was required. This trip 
log, shown in Exhibit 2.5, was an 
attachment to the advance letter which was 


sent to all households. 
Sample Selection 


Generally, the selection of a sampling 
technique depends upon the following 


factors: 


a) ‘the purpose for whichsthe) data twill lobe 
used; 

b) the degree of accuracy required; 

c) the population size; and 

ad) the budget 


The geographical area encompassed by the 


survey was determined at the study's 


inception. It contained the populations 
within Metropolitan Toronto and the 
Regional Municipalities of Peel, York, 


Durham, Halton and Hamilton-Wentworth. 


There were approximately 1.5 million 
households in the study area in 1985. 

Based upon the United States Bureau of 
Public Roads guidelines (see Table 2.1), a 
4% completed sample of all households would 


be adequate. Montreal's experience with 
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TABLE 2.1 


MINIMUM AND RECOMMENDED SAMPLING RATES 
U.S. BUREAU OF PUBLIC ROADS 


Population Minimum Recommended 
Percentage Percentage 


Less than 507000 Oe U 2020 

50,000 - 5:07 000 Seal 12.5 
150,000 - 300,000 aed) Or0 
300,000 - 500,000 2.0 6.6 
500,000 - 1,000,000 Mya) 530 
More than 1,000,000 1.0 4.0 


& fo. 


using the results of its surveys, 
particularly in estimating major transit 
route ridership, suggested that a 4-5% 


sample was satisfactory. 


Based on costs incurred during the 1982 
Montreal Survey, adapted to 1986 conditions 
in Toronto, cost estimates were prepared 
for a number of sample sizes and 
interviewer productivity rates. The 
results indicated that a 4-5% sample 
appeared to be possible with an $800,000 
budget. 


After a great deal of deliberation, the TTS 
participants agreed to apply a uniform 
sampling rate to all the municipalities in 
the study area. The target would be a 5% 
completed sample across the study area, 
with 4% being the acceptable minimum 


sample. 


While it was the intention from the 
beginning that the sample be drawn from 
Bell Canada's data files, it was also 
acknowledged that there are problems with 
this data source. First, there are 
households with no telephone, although the 
most often quoted figures suggest that 
fewer than 2% of households fall into this 
category. Second, households with unlisted 
telephones would not be included in the 
sample. The Socio-Economic Section of the 
Regional Municipality of Peel Planning 
Department acquired from Bell Canada the 
number of listed and unlisted numbers from 


one switch (the first two digits of the 


a0 e 


telephone number) in each of several urban 
areas. The information which is summarized 
in Table 2.2 shows a relatively uniform 
distribution of unlisted telephone 
households throughout the Study Areas with 
no obvious correlation with the 


socioeconomic status of a neighbourhood. 


Bell Canada had two sources from which the 
sample could be drawn. Tele-Direct, a Bell 
subsidiary, could supply names and 
addresses of those residential subscribers 
listed in the white pages of the telephone 
directories. Bell Canada Marketing 
Research (BCMR) could supply similar 
information from Bell's residential billing 
files. Tele-Direct could provide 
information which was current to the end of 
April, while Bell Canada Marketing Research 
billingstistesawereycurrentetoJune, 61986. 


The latter was chosen. 


The Survey Work Group's intent was to 
obtain a uniform sample of 125,000 
households selected in a systematic 
sequential method from Bell's master file 
after being sorted by postal code. The 
number-of households in the sample was 
based on the estimated requirement to 
produce completed interviews with 5% of all 
households. The actual sample, however, 


was selected in the following manner: 
1. The universe was defined as all postal 


codes in the study area (see Table 
ye 
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TABLE 2.2 


Proportion of Unlisted Telephone Numbers 


Location of Switch 


Toronto-Adelaide 
Toronto-Don Mills 
Toronto-Finch 
Toronto-Lawrence 
Cooksville 
Malton 

Oakville 
Brampton 

Markham 

Oshawa 

Newmarket 
Ancaster 
Hamilton-Central 


Hamilton-Mountain 


Total 
Source: Bell Canada 


Total 
Residential 
Services 


23,584 
20 10> 
39,164 
21,412 
45,281 


Shep ase ks 


20,166 
Ta ie) 
10,515 
47,573 
13,066 


Sip eaabe) 


42,292 
41,542 


368,693 


—— 


Number 


Unlisted 


% 
Unlisted 


9.4 
10.0 
hone: 
1 25D 
11.4 
1 06a 


Rural 


LOA 


LOB 


LOC 


LOE 


LOG 


LOH 


LOJ 


LOK 


LON 


LOP 


LOR 


NOB 


TABLE 2.3 


Postal Codes in Sampling Universe 


to 


EO 


ES) 


to 


to 
to 


tO 


to 


iO 


Oo 


1 Xe) 


to 


1J0 


1PO 


1KO 


1TO 


1KO 
lvo 


PEO 


1KO 


1EO 


1NO 


1LO 


1X0 


(all) 


(aly) 


(all) 


(aii) 


(all) 


One 


Urban 


LLG cop ux 


USP 
15 3.¥ 


L4A 


L4P 


L4T 


L5A 


L6H 


L6S 


L7A 
L7E 


L7G 
L7L 


to 


to 


exo) 


to 


to 


to 


to 


1) 


to 


to 


ust 


L4G 


L4Z 


L530 


L6M 


L6Z 


L7J 


L7V 


L8W 


L9OJ 


(at) 


Metro 
Non-Metro 
Total: 


4. 


2 


oe 


From Bell Canada's master file, 
separate files were created for Metro 
and non-Metro residences. In creating 
the non-Metro file, all listings 
Outside the 416 Area Code were 
excluded, while approximately 76,500 
non-resident listings were not excluded 
from the Metro file; 

Based on the households in each file, 
Bell determined the size of the sample 
which should be drawn from Metro and 
from outside Metro. The following 


table gives this breakdown; 


% of Total 
Total Households Sample 
Households in the GTA Required 
966,000 597s Nas 31S 
657,777 40.5% 50,625 
1,624,000 100.00% 125,000 


Bell Canada randomly selected the 
sample from each file; 

Both files were combined, sorted by 
postal code and sent to the printer; 
The printer consecutively numbered the 
records 1 to 60 on a repeating basis to 
create 60 geographically matched 


samples. 


The fact that approximately 76,500 non- 


resident listings were included in the 


Metro file resulted in Metro being 


oversampled. Metro should only have made 


aye 


up 57.0% of the total sample instead of 
59», net OGtunately, pthismwas not’ al magjor 
problem because the completion rates within 
Metro were lower than elsewhere. However, 
the elimination of all records having non- 
416 Area Codes from the final draw resulted 
in several areas on the fringes of the 
Study area having 519 and 705 Area Codes 
not being sampled (see Table 2.4). In 
orders CORCOmrectathissoversagnt, “Bell 
Canada supplied a supplementary sample of 
735 households in the 519 and 705 calling 


areas. 


The actual sampling rate in each Forward 


Sortation Area (rsa)? was reviewed to 


determine if the random sampling process 
resulted in any significant undersampling 
within any part of the Study Area. Table 
2.5 shows those FSA's where the drawn 
sample was lower than 7.5%. Only one area 
within Metropolitan Toronto is included in 
the list - Rexdale (M9W) at 6.8%; 23 areas 
from outside Metro are on the list, but 
most of these have samples over 7.0%. 
‘Overall, it was concluded that the drawn 


sample was acceptable. 


t The Forward Sortation Area or FSA is the 


geographic area defined by the first three 
characters of the six digit postal code. 
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TABLE 2.4 


Fringe Areas Excluded from Original Sample 


1 


this universe of 8724 households. 


9G 


Postal Code No. of Area Regional 
Households Municipality 
Excluded 
519 Area Code 
E70 (ald) 3291 Acton Halton 
LON 1A0 427 Alton Peel 
LON 180 154 Belfountain Peel 
LOP 1HO 34 Limehouse Halton 
LOR 1T0 555 Lynden Hamilton-Wentworth 
LOR 1X0 80 Rockton Hamilton-Wentworth 
LOR 120 90 Sheffield Hamilton-Wentworth 
NOB 1L0 150 Branchton Hamilton-Wentworth 
NOB 2K0 13.0 Rockwood Halton 
705 Area Code 
LOGALLO 97 Udora Durham/York 
LOE 1E0 POE Cannington- Durham 
LOE 1NO 1160 Pefferlaw Durham/York 
LOK 1A0 bigots) Beaverton Durham 
87241 


A supplementary sample of 735 households was drawn from 


TABLE 2.5 
Areas with Gross Sample under vase 


Households” 
Total 2 in Sampling 
FSA Households Sample Rate 
(Rexdale) M9W 10568 718 6.8% 
(Kleinberg, etc.) LOJ 2420 165 6.8% 
(Ajax) L1W 5412 401 7.4% 
(York) L3R 9141 666 7.3% 
L3S 427 28 6.6% 
L4A 449 25 5.6% 
(Mississauga) L4T 9933 aS, 7.4% 
L5A L758 1299 7.4% 
LSE 4069 300 7.4% 
L5H 561zZ 404 WA ek 
L5K 4202 29:5 6.9% 
(Oakville) L6K 5358 391 7.2% 
(Brampton) L6T P3190 980 7.4% 
(Bolton) L7E 387 28 dmas 
(Hamilton) L8H 11319 839 7.4% 
L8J 2206 159 Tha e 3 
L8K 13474 987 7.3% 
L8L 12695 911 La2s 
L8N 7348 497 6.8% 
L8R 4617 339 723% 
L9A 8202 592 Ue 
L9C b23)a7 885 7.2% 
L9OJ B53 Ze 6.5% 
(Branchton, Rockwood)NOB 595 37 6.2% 


: List of all Postal Code Areas (FSA's) with a universe of 
more than 200 households (telephone listings) and a gross 
sampling rate less than 7.5%. 
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Households are defined as those which are in Bell 
Canada's billing file. 
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2.4.5-Direct Data sinery 


Conventional methods of data entry require 
the interviewer to record answers from 
respondents on coding forms. These coding 
forms are usually scanned by supervisory 
personnel and are then keypunched and 
verified to a computer file. The survey 
records can subsequently be checked by 


editing and logic checking software. 


Direct Data Entry (D.D.E.) allows the 
interviewer to enter a respondent's answers 
directly to a computer file via a keyboard. 
This D.D.E. method would be under the 
control of a software package which 
displays the screen(s), accesses survey 
records for input, and allows updates. It 
can also perform logic tests as the 
interviewer inputs the data, store 
completed interviews and perform quality 
control checks. In addition, the system 
may allow for the tracking/scheduling of 
call-backs and may have auto dialling 
Capabilities. Several computer 
Gonhaguraczons Could “support sD .D.E.@ This 
includes a minicomputer with terminals, a 
microcomputer having multi-user 
capabilities with terminals, a large 
microcomputer acting as a file server 
connected to microcomputers in a Local Area 
Network (L.A.N.) environment, and stand- 
alone micros. No matter how D.D.E. 
operates, every interviewer is required to 
have either a terminal or a microcomputer 


on his or her desk. 


ne On. 


Both D.D.E. and the conventional methods 
were considered as viable options for use 
in the survey by the Survey Work Group. 

The selection of one of these methods 
became a major issue in the selection of a 
contractor. The Work Group examined the 
use Of DD. Ewin theyPilot ssunmveyssand 
weighed the advantages and disadvantages of 
each method, many of which are shown in 
Tables26. 


Of the short-listed contractors, four 
indicated having had experience with some 
form of direct data entry including 
Computer Assisted Telephone Interview 
(CATI) systems. However, only one of these 
companies recommended its use in the 
Survey. In the end, the choice came down 
to two competing bids at very comparable 
cost, one proposing a conventional pencil 
and paper approach while the other proposed 
using a CATI system. The majority of the 
Survey Work Group members opted for the 
company proposing the conventional method 
because of the following reasons: the 
overall good impression created by the 
winning bidder, the concerns about the risk 
factors associated with the proposed CATI 
approach, the tight schedule, the fact that 
D.D.E. had not been used in any major 
travel survey, and that no contingency plan 


was offered in case of its failure. 


ee 


*SUIOJ "DUEPOOD 

eqeTduoosut pue eyetTdwuod jo sroequinu 
eabreqT jo yorerq deay of Aazessooon 
SOTGUTTRAR 

A{tpeer aq you Aew sqrzodez 

Toaquos Ayttenb pue sat zerAstutupy 
‘butyOoyo Atpe ACF stTqe[teae 

eq 4FSnwW oTeMpAeY pue SAeMAJOS usUyA 
‘poyounddAsy oq 3ysnu spxz00ea Adaans 


*peatnbeaz st Aasaarns 3yyA jo 

37eRS SYA OF AOTAd aWTQ peeT sseq 
:poatnbert st sanqtuainj pue 

UOTREOOT SATs pejeotyastudos ssey 
*STOMOETAASAUT UTeAQ OF AOtses ST AI 


GOHLAN TWNOLLNAANOO 


*AdaanS [Teaeiy 

zoCew © UT pesn Ussq Asasu sey AT 
‘pedo,Tsasp eq Asnui eTeMAJOS pue 
perztnboe aq ysnw srAeMpAeY Aaynduiog 
‘oaTtsuedxe 

pue ATNOTJJTp souloodsq sAanqtTuangj 

“2 Hbutaztnboe pue jyusudtnbs Areyndwoo 
2yuy JO asnedsq e4Ts e HutAedso7 


foqeATSQTT paeoqhsay 

"Gq gWwOodseq 4ASNnW SAeMAaTAASeAUL *A8eRzeaTH 
St SieMotATe Uw 107 puty BurTuTery 

His ke 22-6 6) 

ae st Adarns 9yy AOF owty dn AaeqAS 
*A[tseo 


eiow pero jTUuOW eq ued sSYyoeq-TTeD 
:Aaesseoou ou St 

swioj butpos azeded jo yoezqy Hhutdeey 

3 :USTOTJJS sr0OW 

ST quswsebeuew Adarns Rey Hbutuesw 

' 4eTqe{teae A[tpeszr ore syr0deIz 
Torquos AjAt{Tenb pue satyzerAstutupy 
‘osusdxs pue AOIAS 

JO eomno0s e se sTtyy Hbutjeutwtte 

"S peatnbez st HbutyounddAsy on 
!tetsea st 

=c stsATeue eqep OUT UOTATSURIA SUL 
-e *ATejeTpowwt pexyooyo AtTpe st ejeg 


AULNA WLVd Load 


GOHLAW TWNOILNAANOD 


4HL SOSYHMA AUYLNA VLVG LOaYIGd 


9°¢C ATAVS 


SAOVLNVAGVSIG 


SASVLINVAGY 


Selection of Contractor 


The draft Terms of Reference for a contractor to 
carry out the telephone interviewing and data 
entry were prepared in mid-May, 1986, and 
approved byathe TATPDESC on’ May 217) 19860 The 
final Terms of Reference are included as 


Appendix B. 


Within the limited time available, every effort 
was made to give all potential contractors equal 
Opportunity@to.ofrer® their services.) @ ihe process 
began on May 21, 1986, and culminated with the 
selection of the successful contractor on June 
27, 1986. Table 2.7 gives a summary overview of 


the selection process. 


All firms thought to have had experience in 
conducting telephone interview surveys in the 
Toronto area were identified through the 


following sources: 


as) suggestions from the members of the Survey 
Work Group; 

ii) the association of professional market 
research firms, which provided its 
membership list, as well as the names of 
some of the larger non-member firms; 

iii) the yellow pages of the telephone directory; 

iv) firms which had already heard of the survey 


and had expressed their interest. 


Over 30 firms were identified. Each firm was 
contacted by telephone May 26th to May 28th, 
informed of the upcoming survey and asked whether 
they would be interested in considering 


submitting a proposal to carry out the field 


—- 3] - 


TABLE 2.7 
SUMMARY OF CONTRACTOR SELECTION PROCESS 


May 2b; '86 Draft Terms of Reference for contractor 
approved by TATPDCSC 


May 21 - 26 List of all potential contractors prepared 
(over 30 companies on original list) 


May 26 - 28 All firms contacted by phone to determine 
interest and to notify of June 2nd 
information meeting 


May 28 All interested companies (28) delivered 
letter by hand confirming invitation to June 
2nd meeting and copy of draft Terms of 
Reference 


June 2 Information meeting for all interested 
companies; 24 people representing 18 
companies in attendance. Full briefing on 
purpose of survey, major requirements, 
selection process. Invited to submit 


credentials 
June 2 - 9 Finalization of Terms of Reference 
June 9 Eight sets of credentials received (total of 


13 companies) 


June 10 Credentials evaluated by agency staff; three 
eliminated; 5 forwarded final Terms of 
Reference, invited to submit full proposals 


June 16 - 20 Agency staff inspect facilities of five 
firms, answer questions on Terms of 
Reference. 


June 23 Proposals received from five firms; 
circulated to agency staff 


June 26 Proposals evaluated by agency staff; three 
eliminated; two asked to be interviewed on 
June 27 (both given same list of questions to 
respond to during interview) 


June 27 Two finalists interviewed; final evaluation, 
selection of preferred Contractor; decision 
ratified by Steering Committee meeting in the 
afternoon. 


tae 


work. A few companies declined. For those that 
were interested, the name of the appropriate 
contact person was noted and they were advised 
over the telephone of an information meeting on 
June 2, 1986. A personalized letter addressed to 
the contact person, together with a copy of the 
draft Terms of Reference for the work to be 
contracted out, was subsequently delivered by 
hand on,May 28th to each .of the 928° (fa yusy whitch 
expressed an interest. The letter confirmed the 


information already given over the telephone. 


Twenty-four persons representing eighteen 

companies attended the meeting on June 2, 1986. 
During the meeting the General Manager outlined 
the key elements of the Terms of Reference with 


emphasis on the following: 


at’) It was a requirement that the Contractor's 
Chief Supervisor had had directly relevant 
travel survey experience; 

ii) The importance of the interviewer producti- 
vity rate in estimating costs and the 
variance in interviewer productivity between 
Montreal, Vancouver, and the Pilot Survey in 
[LOuOnEO? 

iii) The Contractor was welcome to submit a pro- 
posal to carry out the survey using conven- 
tional pencil and paper methods and/or using 
direct data entry on computer terminals or 
free standing microcomputers; 

iv) The Contractors were encouraged to consider 


forming consortia. 


aa Ye ye ls 


The General Manager described the proposed 

contractor selection process and asked for input 
on the method and the timing. There appeared to 
be general agreement on the approach as proposed; 
the suggestions made on the timing were accepted 


by the General Manager. 


Those in attendance were invited to formally 
submit their credentials for undertaking the 
project and June 9, 1986, was established as the 
last day for the submission of credentials. 
Eight sets of credentials were received, six of 
which were for individual companies, while one 
was for a consortium of two companies and another 
was for a consortium of five companies. In 
addition to the 13 companies participating in 
presenting their credentials, five companies 
advised that they would not be submitting 
credentials and there was no response from three 
of the companies that attended the information 


meeting. 


The eight sets of credentials were evaluated in 
detail by the Household Survey Team on June 10, 
1986, using a "rating form" prepared for the 
purpose. Through this process three were 
eliminated; the remaining five were invited to 
submit detailed proposals for the project by June 
23, 1986. The five candidates were also advised 


to keep June 27th open for interviews if needed. 


During the week of June 16th, members of the 
client agencies visited each of the five 
companies/consortia to inspect their facilities, 
meet their staff and to answer any questions on 


the proposed survey. The impressions gained 


ec oo 


ss 


during these visits formed a part of the 


subsequent rating of the five proposals. 


The Household Survey Team met on June 26, 1986, 
to evaluate the five proposals. After a lengthy 
and detailed rating process, the Team recommended 
to the Work Group that three companies be 
eliminated from further consideration and that 


the remaining two companies be interviewed. 


The two remaining proposals had very similar 
costs, but differed greatly in their methodology 
with one proposing a CATI (computerized) system, 
while the other proposed a conventional pencil 
and paper approach. For the reasons mentioned in 
Section 2.4.5, the decision was made immediately 
after the interviews on June 27th to offer the 
project to Consumer Contact Limited (CCL), the 
firm which proposed a conventional pencil and 


paper approach. 


Selection and Training of Field Staff 


The Survey Work Group recognized that the 
telephone interviewers would be the key link 
between the respondent and the end-users of the 
data. Consequently, considerable emphasis was 
putvon thevhiring and*®training of staff an "the 
Survey Terms of Reference to which contractors 


were requested to respond. 


Sections 2.7 and 2.8 of the Terms of Reference 


stated: 


5 T 


2.7 Rates of Pay 


The TATPDCSC is concerned about the quality of 
staff and the turnover of staff (particularly 
interviewers, but also supervisors and others) 
who will be employed by the Contractor to 
carry out the Survey. The rates of pay and 
any incentive plan will have a bearing on a 
Contractor's ability to attract and retain 


good personnel. 


It is a requirement that the proposed rates be 
listed in the proposal. Any incentive plan 
for minimizing turnover should be described in 


the proposal. 
2.8 Staff Training 


The TATPDCSC considers training of the 
interviewers and their supervisors, and the 
checkers, correctors and coders to be critical 
to the success of the survey. TATPDCSC 
personnel are to be given a minimum of four 
hours during the training process to instruct 
the Contractor's staff on the purpose of the 
Survey, the unique characteristics of 
conducting an Origin-—Destination Travel 
Survey, and how to deal with a range of 
possible travel situations. The Contractor 
would be responsible for other aspects of the 
training, including instructions on 
administrative procedures, general 


instructions on dealing with the public, etc. 
TATPDCSC personnel will have the right to 


reject any of the staff after the training 


program.” 
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During the course of the Pilot Survey it became 
apparent that training interviewers for origin- 
destination travel surveys is significantly 
different from training them for the types of 
Surveys normally conducted by marketing research 
firms. In particular, the single evening five 
hour session consisting wholly of classroom 
instruction, which served as the training program 
for the Pilot Survey, did not adequately prepare 


the interviewers. 


Consumer Contact Limited, in responding to the 
Terms of Reference proposed a training program of 


16 hours over four evenings, broken down as 


follows: 

3 hours - Introduction, general 
interviewing/sampling techniques; 

4 hours - TATPDCSC orientation; 

5 hours - Specific questionnaire study and 
"role playing" practice interviews; 

4 hours - Practice "live" interviews (randoin 


calling from telephone directory). 


Regarding overall staff hiring, CCL estimated in 
their proposal, the need for 70 telephone 
stations and the need to hire 1.5 times the 
number of stations to be manned, or approximately 
95-100 persons. Staff would be trained in groups 
of 20-25 which, coupled._with a single supervisor 
training session for the required 18-20 
Supervisors, indicated a need for five full 


training sessions. 
The CCL proposal suggested that considerable 


emphasis was placed on hiring motivated, highly 


capable staff. CCL also suggested that their 
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location provided good access to a suburban 
labour pool, particularly Seneca College 
students. Supervisors were to be drawn from 
CCL's existingsinterviewing staff. In general, 
the overall approach, which called for an 
intensive co-operative training program by 
TATPDCSC and CCL, development and use of a 
comprehensive interviewer training manual and 
emphasis on selection of qualified staff 
generated confidence in a successful survey. 
Members of the TATPNDCSC had expressed concerns 
that rates of pay ($5.50 per hour for 
interviewers) were low and might inhibit the 
hiring and retention of high quality staff; CCL 
convinced the TATPDCSC that the rates were 
competitive within the industry and that, because 
of their "especially convenient suburban 
location, part-time labour is easily attracted 


without having to resort to premium rates of 
pay" 

The TATPDCSC asked CCL to suggest potential cost 
savings. Among other steps, the TATPDCSC agreed 
to reduce the $13,400.00 incentive program for 
employees by $12,000.00. In discussing this 
measure with CCL it was concluded that the 
incentive plan would not be critical to retaining 
staff. As the survey proceeded, however, it was 
found necessary to restore the $12,000 as 


incentive pay for employees. 


The first training session was held in the last 
week of August, 1986, for 19 supervisors. Based 
on that experience, a number of revisions were 
made to both the training procedure, the training 


document and the interview script. TATPDCSC 


me ee 


personnel prepared twelve sets of sample 
responses for simulated interviews ranging in 
degree of complexity and an overall framework was 


developed for the three training sessions: 


Night 1. - Overview presentation of general | 
information by CCL, general overview 
of training manual and question and 


answer period by TATPDCSC members. 


Night 2. - Simulated interviews in groups of 
three with supervisors and TATPDCSC 


members acting as "respondents"; 


Night 3. - Live interviews, with monitoring by 


supervisors. 


It quickly became apparent that the number of 
interviewers that needed to be trained had been 
underestimated. Due to high staff turnover and 
low participation rates (i.e. interviewers worked 
only one or two evenings per week instead of 
three or four) it became necessary to train many 
more interviewers than expected. Training became 
a permanentafeaturejyof the DTS. | gRathersthan five 
training sessions, there were 26; 390 
interviewers started training, compared with the 
original estimate of approximately 100. In order 
to minimize costs and the demands on TATPDCEC 
staff time, part way through the survey the 
training sessions were reduced to two nights, on 
the understanding that CCL would distribute 
training manuals for review prior to the first 


Night ofstrainangs 
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Publicity and Public Relations 


The objective of the Publicity and Public 
Relations Program was to enhance the public 
response to the survey through publicity and 
public relations measures. The activities 
included compiling and putting out press 
releases, arranging press conferences, 
establishing procedures for public enquiries, 
designing material which would be going to the 


public and miscellaneous other activities. 


The Program was designed and implemented by the 
Public Affairs Office of the TTC with assistance 
from public relations staff from the Hamilton 
Street Railway and the Ministry of Transportation 
and Communications. P. R. Lamont Advertising 
Ltd. was retained to carry out specialized 


assignments on behalf of the Team. 


One of the initial tasks was to select a name and 
logo for the Survey. Several alternative names 
and logos were developed. The TATPDCSC selected 
"Transportation Tomorrow Survey" together with 
the logo shown on the letterhead in Exhibit 2.4. 
The Transportation Tomorrow Survey (TTS) was used 
consistently in all material related to the 


survey. 


The survey procedure included provision for 
mailing out a personally addressed letter signed 
jointly by the Minister of Transportation and 
Communications and the Regional/Metro Chairman in 
advance of telephone contact. The advance letter 
which was developed for the Pilot Survey and 
rewritten by technical staff for the main survey, 


was forwarded to the Publicity and Public 


eA Oke 


Relations Team for review. With the assistance 
of P. R. Lamont Advertising Ltd., the style of 
the letter was revised significantly with a view 
to improving comprehension and the level of 
interest. The final letter is shown in Exhibit 
Dios 


Plans were initiated for a series of press 
conferences in each Regional Municipality during 
the week before the start of the Survey. 
Beginning with Hamilton-Wentworth and ending with 
Metropolitan Toronto, a press conference was 
arranged for each Regional Headquarters for the 
local media with the local Regional Chairman 
being the key spokesman. Also participating in 
the press conference was the General Manager of 
the Survey and a Regional Transportation Planning 
Official. In the case of the Metro press 
conference, the Minister of Transportation and 
Communications also attended. Table 2.8 shows 
the schedule of the press conferences which were 
held during the week and a typical program/agenda 
for these sessions is shown in Exhibit 2.6. 
Prepared text and graphic material was produced 
by. thewfTC PublicfAfiagrseOt fices 


Special information packages were assembled and 
distributed, tosgall local, officials es inclmdangeall 
Chiefs of Police, all Regional and Local 
Councillors, all Chief Administrative Officers, 
Clerks, Information Officers, Engineers, 
Plannersy«eandeTraffics0fticials pallyMReetes; 
all M.P.'s-and all-transitsagencies. /.The TTC 
Public Affairs Office prepared the packages and 
forwarded the required number to a designated 
person at each Region for distribution within 


that Region. 
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HAMI LTON—WENTWORTH 
Monday, September 8 
10:00 AM 


HALTON 
Monday, September 8 
2:00 PM 


YORK 
Tuesday, September 9 
10:00 AM 


TORONTO 
Tuesday, September 9 
1:00 PM 


DURHAM 
Wednesday, 
September 10 
2:00 PM 


PEEL 
Friday, September 12 
2:00 PM 


TABLE 2.8 


SCHEDULE OF PRESS CONFERENCES 


The Regional 
Municipality of 
Hamilton-Wentworth 

Hamilton, City Habs 

Council Chambers 

71 Main Street West 

Hamilton, Ontario 


The Regional 
Municipality of Halton 
Regional Adminis. Bldg. 
Council Chambers 

1151 Bronte Road 
Oakville, Ontario 


The Regional 
Municipality of York 
Adminis. Bldg. 
Council Chambers 

62 Bayview Avenue 

Newmarket, Ontario. 


The Municipality of 
Metropolitan Toronto 
New City Hall 
Committee Room #2 
Toronto, Ontario 


The Regional 
Municipality of Durham 
Council Chambers 

605 Rossland Road East 

Whitby, Ontario 


The Regional 
Municipality of Peel 
Peel Regional Offices 
Councillors' Lounge 
10 Peel Centre Drive 
Brampton, Ontario 


moe 


Contact: Ted, Gril 

Manager 

Project Planning 
Transp., Dept. 


526-4339 


Contact: 
Manager 
Policy Division 
Planning & 
Development 
827-2151 


Ho Wong 


Contact: John Barnes 

Transportation 
Planner 

884-1611 


Contacts 

Dave C. Ferguson 
Transp. Division 
Planning Dept. 
392-8115 


Contact: Jeff Mark 
Senior Planner 
Planning Dept. 
668-7731 


Contact: 


Doug Thwaites 
DITectorsor 
Transp. Policy 
791-9400 Ext. 351 


Exhibit 2.6 Lee 


TYPICAL PRESS CONFERENCE AGENDA 


Schedule of Events for the Transportation Tomorrow Survey 


News Conference 


Municipality of Metropolitan Toronto 


Tuesday, 


1 Oe) 


City Hall 


PM 


September 9, 1986 


Committee Room #2 


1:00 


PM 


PM 


PM 


PM 


PM 


PM 


News Conference begins 
Welcoming Statement Chairman C. Dennis Flynn 
Introduction of Head Table Chairman C. Dennis Flynn 


Mr. Toivo Rukholm, General Manager 
Transportation Tomorrow Survey 


Honourable Ed Fulton, Minister of 
Transportation and Communications 


Presentation on Survey Toivo Rukholm 

Remarks Chairman C. Dennis Flynn 
Remarks Honourable Ed Fulton 
Questions 


New Conference Ends 


Arrangements were made to have telephone numbers 
and names for people to call with questions and 
complaints. The Ministry's Public and Safety 
Information Branch agreed to handle calls during 
OLETCesNOUrS soo UeasmettO 7430 Pema) sand this 
information together with a toll-free number was 
provided in the advance letter (see Exhibit 2.4). 
Subsequently, arrangements were also made to 
accommodate such calls after office hours. Since 
TATPDCSC coding staff were working during evening 
hours a toll-free line was put in their work area 
and they dealt with public enquiries (as well as 
the callbacks resulting from messages left on 
answering machines and miscellaneous other 


callbacks). 
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3. TELEPHONE INTERVIEWING 


3.1 


Final Preparations for Field Work 


The final preparations for the telephone 
interviewing began in early August, 1986. The 
Chief Supervisor assumed his position at the 
beginning of August. Telephone interviewing 
Supervisors were recruited from among the 
contractor's experienced personnel and underwent 


training August 26 - 28. 


The field operations were to be conducted from 
Toronto and Hamilton. The contractor required 
additional space within his building near 
Victoria Park Avenue and Sheppard Avenue East to 
accommodate sixty telephones for the Toronto 
operation; from this base the coverage included 
Metropolitan Toronto and the Regional __ 
Municipalities of Durham, York and Peel. 
Arrangements were made to allow the Hamilton 
operation to use Transportation Department 
offices in Hamilton City Hall where twelve 
telephones were available; the Regional 
Municipality of Halton was called from this base, 
in addition to all areas of Hamilton-Wentworth. 
It should be noted that some Hamilton-Wentworth 
and Halton calls were also made from Toronto, 
particularly near the end of the survey period, 
and throughout the survey period in the case of 
callbacks for clarification purposes and for 


interviews in special languages. 


The Toronto operation contained an office for the 
Chief Supervisor and his Assistant with the rest 
of the area divided into five rooms or work 


areas, with twelve telephones in each work area. 
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Each work area contained a desk for a supervisor 
and places for ten interviewers with push button 
telephones, and a table for an assistant 
Supervisor/monitor with a telephone which could 
be used to monitor or "listen in" on the ten 
interviewers. The contractor's regular telephone 
room containing twenty telephone lines was 
located adjacent to the area dedicated to the 
Transportation Tomorrow Survey; some or all of 
these lines were, dedicated) toaTTS caldsgon 


occasion. 


In Hamilton, the Transportation Department office 
area was used by the contractor during non-office 
hours. Ten telephones were available for 
interviewers and the secretary/receptionist's 
telephone was modified to permit monitoring by 
the supervisor or the assistant supervisor/ 
monitor. The Hamilton office also included a 
data entry person with a special computer 
terminal who entered completed interviews 
directly to the computer in the contractor's 
offices in Toronto via a Bell data communications 


line. 


The belaphanee were installed and operating in 
the Toronto work areas by the end of August. The 
modifications to the telephone system in Hamilton 
were completed by September 10. Interviewers 
were recruited during the last part of August and 
early September with training being conducted 
September 3 - 14. 


SAS 


Description of Field Operations 


Telephone interviewing began on the evening of 
September 16, 1986, and continued through the 
evening of December 13, 1986!. Interviewing was 
conducted between the hours of 5:00 p.m. and 9:45 
p.m. Monday to Friday, and between the hours of 
10:00! a.m and 5:00 p.m. on Saturdays. 

Personally addressed advance letters were mailed 
out beginning September 8, 1986. The letters 
were produced by laser printer with the names and 
addresses being read directly from the tape 
containing the sample provided by Bell Canada 
Marketing Research. The printing of the letters 
and regular mailings were carried out by a 


professional printing firm retained by the 


contractor (CCL) to provide this service. Due to 


the variation in postal delivery times it was 
found necessary to mail the advance letter up to 
two weeks before the expected interview date to 
ensure that households received the letter before 


being telephoned. 


The Chief Supervisor together with his Assistant 
was responsible for the daily operation of the 
interviewing. He attempted to schedule 
Supervisors and interviewers to meet the 
production requirements and was responsible for 
daily output, assigning workload and priorities, 
maintaining discipline, resolving day to day 


problems and keeping records. 


Interviewing was also conducted from February 16th to 
February 20th, 1987, to supplement the sample within 
the 705 and 519 calling areas. 


Ate 


The Supervisors assigned work to their 
interviewers, checked completed interviews for 
completeness and consistency, monitored 
interviews in progress and compiled daily 
statistics for the Chief Supervisor. The 
Monitors/Assistant Supervisors generally helped 
the Supervisors with primary responsibility for 
monitoring interviews in progress and checking 
the monitored interviews against the forms as 


completed by the interviewer. 


In addition to the monitoring by contractor's 
staff (i.e. supervisors, monitors and others), 
the client group also observed and listened to 
the interviewing. All of the client agency 
representatives on the Survey Work Group, as well 
as other senior agency staff on the TATPDCSC, 
participated in a scheduled program of monitoring 
the telephone interviewing. Agency staff from _ 
Hamilton-Wentworth and Halton monitored the 
interviewing in Hamilton, while the other staff 
covered the Toronto operation. These client 
monitors recorded their observations on the form 
shown in Exhibit 3.1 and passed on their comments 
to the Chief Supervisor, or if immediate action 
was warranted, to the Supervisor of the group. 
The client monitoring allowed agency staff to 
gain a better appreciation of the quality of tne 
data, and early detection of a number of 
problems. An unexplained rise in respondent 
refusal rates during the ninth week of the 
Survey, which was detected by client monitoring, 
was traced to a problem with the mailing of 


advance letters. 


Sample households were assigned in a random 


fashion to individual interviewers to prevent any 
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systematic variation in the quality of the 
interviews. Five attempts were made to contact 
each household with busy signals not counting as 
an attempt. If there was no answer after seven 
rings, it was recorded as an attempt; the next 
attempt could not be made for at least two and 
one half hours. Answering machines were treated 
as per Section 2.4.1. .The status of each sample 
household was recorded on the coding form after 
each attempt (see Exhibit 2.3 for the format for 


recording interview status). 


The travel day for the household, in most cases, 
was the day before the telephone call. However, 
there were some situations where the "day before" 
rule did not apply. From the beginning, Monday 
night calls, as well as Saturday calls, asked for 
trips made on Friday. When it was noted that 
Thursday travel days were under-represented 
because of the difficulty in finding people at 
home on Friday evenings, a portion of the 
Saturday interviews were assigned to ask for 
trips made on the preceding Thursday. The "day 


before" rule also did not apply when an interview 


was being conducted to finish a partially 


completed survey from an earlier date; in this 
case the original travel day continued to be the 


day of interest. 
Performance Statistics 


A total of 61,708 households were successfully 
interviewed during the Survey. Table 3.1, 
Completions by Survey Trip Day, shows the number 
of interviews completed for each trip day from 
Monday, September 15, 1986, to Thursday, December 


11, 1986. Also shown are the small number of 
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supplementary interviews completed for the week 
of February 16, 1987, with households in the 519 
and 705 calling areas which had been omitted in 
the original sample. It should be noted that no 
interviewing was done for trips on Thanksgiving 
Day (October 13) and only 75 interviews were 


completed for Rememberance Day (November 11). 


This Table shows the distribution of the 
completed interviews by day of the week and by 
month. The completions on each weekday are 
within 11% of the 12,000 target level; all days 
except Tuesday (11,069) are over the targeted 
number. The distribution by week over the time 
span of the survey is relatively uniform with 
approximately five thousand interviews completed 


each week. 


Table 3.2 shows the major statistics related to - 
the use of the sample. Contact was attempted by 
telephone with a total of 102,606 households. 
Almost seven thousand (6,738) telephone numbers 
were found to be "not in service". This reflects 
the fact that the sample was based on the June, 
1986, billing records and this data base was 
becoming increasingly out of date as the survey 
proceeded. Over ten thousand households 
(10,976), or 10.7% of all households called, 
could not be contacted even after five attempts 
spread out over three or more days. Slightly 
over one thousand (1,128) calls reached 
ineligible respondents - either business 
establishments (598) or households located 
outside the region which they were supposed to 
represent (530). A small number of households 
(358) could not be interviewed because they did 
not speak a survey language (neither English nor 


one of the other nine survey languages). 
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Table 3.2 Sample Usage 


Completed Interviews 61,708 a) 
Language Barrier 358 (2) 
Refusals 21,698 30) 
Total Eligible Contacts (1)+(2)+(3) 83,764 (4) 
Not eligible 1128 (5) 
Not in service 6,738 Seo) 
No answer after 5 attempts 10,976 (973) 
eee renee eee eee 
Total Sample Used (4)+(5)+(6)+(7) 102,606 (8) 
Refusal Rate (3)/(4) 25.9% 

Response Rate (1)/(4) 73.7% 
Completion Rate (1)/(8) 60.1% 
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The number of refusals totalled 21,698 
households, or 25.9% of all the eligible 
households which were contacted. This compares 
unfavourably with the 8% refusal rate experienced 
in Montreal in 1982, the 14% refusal rate 
documented in the 1979 Metro Travel Survey and 
the 15% refusal rate encountered during the Pilot 
Survey. However, it is very similar to the 25% 
refusal rate encountered in Vancouver during a 


Similar survey in 1985. 


Interviewer productivity is measured in terms of 
completed interviews per hour of interviewing 
time. This 1S an overall productivity rate and 
takes into account all interviewer time, 
including breaks and time for administrative 
tasks. Exhibit 3.2 shows the fluctuation in this 
measure of productivity on a daily basis from the 
beginning of the survey September 15, 1986, until 
November llth, during the ninth week of the 
Survey. It is evident from Exhibit 3.2 that 
productivity was significantly lower on 

Saturdays - the lowest points on the chart are 
invariably Saturdays. It was expected that it 
would be more difficult to make telephone contact 
on Saturdays due to shopping and weekend travel. 
It is also evident that there was an initial 
learning period lasting approximately two weeks, 
during which the productivity rate was on an 
upward trend. After the First two weeks, while 
the rates fluctuated around the average, there 
was no discernible upward or downward trend. The 
average productivity rate stabilized at 
approximately 3.5 completed interviews per 
interviewer hour. By way of comparison, the 
Vancouver survey in 1985 achieved close to 4.5 


completed interviews per interviewer hour, while 
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the Montreal survey in 1982 achieved over six 
interviews per interviewer hour. There is no 
apparent fundamental difference between the three 
Metropolitan areas, or the design of the three 
surveys, which would account for the large 
difference in interviewer productivity. 
Differences in questionnaire detail and 
computation do account for some of the variation. 
Also, in Montreal, there are significantly fewer 


trip makers. 


Exhibit 3.3 shows in graph form the number of 
completed interviews per attempt. Slightly more 
than half (50.7%) of the total completions were 
achieved on the first call, while three quarters 
(75.9%) were completed after two calls. The 
fifth call was responsible for about five per 


cent (5.6%) of the completions. 


Table 3.3 shows the sample distribution by 
Regional Municipality within the Greater Toronto 
Area. The Table includes the known distribution 
of households, the distribution of the completed 
interviews and the final sample size achieved in 
each Region. The distribution of completed 
interviews among the Regions is very close to 
their share of the Study Area households; only 
Metropolitan Toronto displays a noteworthy 
variation in the distribution of the completed 
interviews. Metropolitan Toronto contains 57.0% 
of the households within the Greater Toronto 
Area, while only 55.8% of the total completed 
interviews were from Metropolitan Toronto; the 
final sample size in Metropolitan Toronto was 
4.0% compared to the Study Area average of 4.1%. 
On the other hand, 7.5% of the interviews were 
completed in the Regional Municipality of York, 


which contains only 6.7% of the households, 
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7% OF FINAL COMPLETIONS 


Exhibit 3.3 
PROPORTION OF INTERVIEWS COMPLETED 
AFTER EACH ATTEMPT 


ATTEMPT NUMBER 


Table 3.3 Sample Distribution by Region 


Region | Distribution of | Distribution of]! Final 
| Households | Completions | 
| | | Sample 
| | | 
| | | Size 
| | | 
| | | 
| Number % | Number % | & 
| | | 
| | | 
Metropolitan Toronto we 85351500 57. Ome 3 4,398 at me ee ee 
| | | 
Peel | 184,200 et | 7,661 2G.4 ieee 
| | | 
Hamilton—Wentworth | 161,700 LOn 6 clam orto Ag LOS Gre tet 
| | | 
York ohOons00 Gra, Sees OCS reo vee ea. 6 
| | | 
Durham ee Ov. B00 Tha Ne RIE Went [Aree 
| | | 
Halton | 89,800 6.0 | 4,050 6.6 | 4.5 
| | | 
| | 1 | 
Total: 4977300) 9100-50: e617 6m4 Ie Oa 
| | | 
1 


Thirty-four interviews were from households external to the study 
area or unassigned. 


oe ae 


resulting in a 4.6% sample within York. A high 
response rate in Halton resulted in a 4.5% 


sample. 
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DATA ENTRY, CODING AND EDITING 


This chapter outlines the processes related to data 
entry, coding and editing._of the TTS.data. The 
functions and tasks discussed in this chapter are 
illustrated in Exhibit 4.1. 


4.1 Data Entry 


The information collected by the telephone 
interviewers was manually recorded on coding 
forms (Exhibit 2.3). Next, data entry operators 
entered the data using the DASH-1+ data entry 


system on a Data General MV4000 minicomputer. 


The DASH-1 software is designed to allow data to 
be edited as it is entered. Mandatory fields are 
designated and range checks and logic checks can 
be programmed into the system. For example, only 
legitimate codes could be entered for trip 

purpose or travel mode. Originally all editing 
was performed on-line, but the procedure proved 
cumbersome and slow so the range checks were 

separated from the logic checks. The range 

checks were performed on-line at the data entry 
stage; the logic checks were done in batch mode 


following data entry. 


Error reports were produced and the corrected 
Survey records were re-entered. Corrections 
which could not be deduced From the original 
survey form were checked with field staff, if 
necessary, or sent back to the interviewer for a 
callback if required. 


" The DASH-1 system is a proprietary data entry 


software package developed by Microways. 


= 569— 


G4003Y AIANS NYS 


O13 “S3INOLOSYIC “SAVN 
‘dNV OL Yad3Yy SY3GO9 


44V1S ONIGOD OL 
S40934 NVSIONN 


JNILIGS 


SMOSH 919071 TWNOLLIGOY 


SALNOY LISNVYL JO SNIGOD 


INIOd Ya4dSNVYL ONY 
NOLLYNLLSSG dial 
"NISIMO dIdL 
‘SS3YGGV MIOH3SNOH 


JO SNIGO9039 


| 


SS300Ud SONILIGS GNV DNIGOOS ‘AYLN] Viva 


vy wgiYyx3 


NdNOD ONIN OL 
G3YSISNVUL VLVG 


SHI3HI 391907 
G3LdINaA VLYG 


SHI3HO JONVY 
YALNdNOOININ NO 
Q3Y31N3 Viva 


YOSIANSdNS Ag 


G3SM3W3Y SNYO4 
AANINS GaLmNdNoD 


$A YO 
MAIANGLNI TWLLNI 
INIGOO AYLN3 VLVG MAIAYSLNI SNOHdSTSAL 


From the MV4000, the data was transferred to a 
Convergent Technologies NGEN microcomputer where 
geocoding of trip origins and destinations was 
performed together with transit route coding. 

The Convergent Technologies NGEN system was used 
because it provided the necessary multi-user 
capability and because a preliminary version of 
the geocoding software had earlier been developed 
on Convergent Technologies hardware owned by the 
Ontario Ministry of Transportation and 


Communications. 
4.12] Verilticationk 


Based on the extensive range and logic 
checking capabilities of the DASH-1 
system, it was decided that verification 
of 10% of the survey forms would provide 
sufficient control on the quality of the 


data entry. 


When it became apparent that the DASH-1 
system could not handle all the required 
range checks and logic checks during the 
data entry, the verification procedure was 


revised to the following: 


1. Each operator entered eight 
questionnaires, then checked all 
address fields (home address + trips) 
and corrected any errors found. The 
bundle of eight was then taken to a 


verifier. 
2. The verifier picked one form at random 


and verified the data. If zero errors 


were found, the bundle was accepted. 


et 


4.2 


Coding 


4.2.1 


If one error was found, the verifier 
selected another questionnaire from 
the bundle of eight and verified the 
data. If no further errors were found 
the bundle was returned to the 
Originals datayentry. eperator i) Limore 
than one error was found in the first 
or second questionnaire the entire 
bundle was returned to the operator 
who checked all eight forms again. 

The process was then repeated until 
the bundle was felt to be satis- 


Factory. 


This process provided a method where 
the data was verified and the data 
entry operator causing specific 
problems was identified. The 
operators were coached or retrained to 
eliminate the source of identified 


problems. 


Geocoding 


Geographical referencing or "geocoding" was 
used to record the locations of (cheno! 
origins and destinations with X and Y 
coordinates to the blockface level of 
detail. Subsequently, the data can be 
aggregated to any alternative zone system 
simply by defining the coordinates of the 


zone boundaries. 


Each origin and destination location 


description was either a numbered street 
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address (usually the home address), an 
intersection or a place identified by its 
name (referred to as a monument). These 
locations were entered into the computer in 
fixed field formats which varied depending 
on the type of location description 
specified. The records then passed through 
the geocoding programs which assigned the 
corresponding geocode for the location 


specified. 


TTS data has been coded to the UTM 6 degree 
system which is capable of defining 
longitudinal and latitudinal coordinates to 
the nearest metre. The coordinates 
actually used in the TTS give locations of 
the centre of the nearest blockface. In 
the case of a residential address, the 
corresponding blockface would be a point 
midway between intersections and set back 
22 metres from the centreline of the 


roadway. 


The geocoding system used by Statistics 
Canada was adopted for the Survey. 
Statistics Canada has built up detailed 
computer files for many parts of the 
country linking street addresses to a 
blockface geocode. These files, known as 
Area Master Files (AMF's) were available 
for all of the GTA except for one small 


area (the Town of Caledon). 


The AMF is organized by local municipality. 
In order to identify a street or monument 
the correct municipality must he indicated. 


Ten characters provided sufficient space to 
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allow every local municipality to be 
uniquely identified. Even with a ten 
character field the number of misspellings 
and data entry errors for each municipality 
was large. For instance, the City of 
Scarborough had more than one hundred 


different spelling variations. 


In order to solve the problem of 
respondents referring to addresses in 
Metropolitan Toronto as being in the City 
of Toronto, alias records were created in 
Toronto for all streets located in 
Etobicoke, North York, York, Scarborough 
and East York. These alias records 
referred to the real streets in the 


appropriate municipalities. 
Monuments 


Many monument names uniquely identify a 
particular location such as "CN TOWER" 
while others describe several possible 
locations. In order to determine the exact 
location of a monument such as “McDonalds 
Restaurant" a description is required. For 
example "McDonalds at Jane and Wilson" 


identifies a unique McDonalds. 


The original AMF contained about 300 
monuments. In addition the Regional 
Municipalities identified about 3,000 
monuments. The information provided 
included the monument name, type, 
municipality and street address. Location 
coordinates were assigned to monuments by 


looking up the street address in the AMF 
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for monuments identified before and during 


the survey. 


Alias Files 


Alias files were created to eliminate the 
need to look up an address more than once. 
For example, when a monument was spelled 
correctly but in a version different from 
the original record on file (CN Tower 
versus C. N. Tower) the correction process 
was Simplified because all that was 
required was to reference the alias record 
to the real record. When a street name or 
a monument was misspelled it could be 
corrected by either correcting the original 
record or by creating an alias record and 
referencing the misspelled version of the 
street name to the correct spelling of the 
street. Future similar misspellings of the 
same street were automatically corrected by 


the geocoding software. 


Transit Route Coding 


Transit trips were identified by the 
operating agency of the vehicle (e.g. 
Markham Transit) and a description of the 
route that was used by the respondent (e.g. 
Yonge Subway). In most instances, transit 
route number codes were not recorded by the 
interviewers. Some respondents referred to 
transit routes by route number and if that 
was the only information offered, the code 
was recorded. For the remainder, route 
description look-up files were created and 


the computer software was designed to auto- 
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matically assign the correct route number 


code. 


To allow for the different methods that 
respondents used to describe transit 
routes, an alias route description was 
automatically created each time an exact 


match was not found. 


This policy of free-field data recording 
was adopted because interviews were 
conducted in a conversational form rather 
than a rigidly structured form. 
Interviewers were instructed to not 
interrupt the flow of an interview to make 
an entry which would satisfy the computer. 
Corrections were to be made at the end of 


the interview. 
Editing 
Mistakes or insufficient data resulted from: 


1. respondents providing incorrect or incomplete 
information; 

2. interviewers misspelling entries on the 
interview form; 

3. interviewers completing interviews with gaps 
or omissions in the recorded information; and 
supervisors failing to catch the omissions; 

4. typographical mistakes by data entry 
operators; 

5. deficiencies in the various look-up files in 


the geocoding system. 
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4.3.1 Geocoding Errors 


The types of errors detected during the 


geocoding process included the following: 


a) 


b) 


Municipality name not found in the AMF. 


The first step in any location lookup 
was to look up the municipality number. 
The municipality number was required to 
access all of the other types of 


records. 


Street name or intersection not found 


in the Area Master File. 


Initially the software attempted to 
find all street header records that 
matched the specified municipality 
number, street name, street type (e.g. 
street, avenue, etc.) and direction 
(i.e. East, West, etc.). If no records 
were found then the lookup was 
attempted once more, this time with the 
street type dropped from the selection 
criteria. If no street header records 
could be found that matched any of the 
above criteria, then an alias record 
was added to the system (see Section 
4.2.3), an error message was returned 
and the lookup was considered to be a 


failure. 


When performing an intersection lookup, 
the program attempted to look up the 
municipality number, followed by both 


of the street name records. If any of 
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these could not be looked up then an 
error message was printed and the 


lookup was aborted. 


Monument name does not exist in the 
AMF. 


If a monument lookup was unsuccessful, 
an error message was generated and an 
alias record was created for that 


monument. 


Address falls below or above existing 


street number ranges. 


Detection of the above problems 
necessitated reference to the AMF to 
determine the cause of the problem for 


correction. 


Software was produced to allow easy 
access to the AMF in a menu driven 
environment. The menu offered twelve 


options. Each option in turn led toa 


. number of prompts which allowed 


examination of the AMF. Besides 
displaying X and Y coordinates of 
addresses, intersections and monuments 
there was an option to list all streets 


intersecting with a given street ina 


given municipality. Another option 


provided a list of monuments from 
incomplete information. For instance, 
by entering the municipality and the 
first few characters, the software 
generated all monuments in that 


municipality that start with those 
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letters. Another option was used to 
study the address ranges and the 
corresponding coordinates for any given 
street by entering the street name and 


municipality. 


After a problem was solved, additional 
software was available to access either 
the AMF for maintenance or the 
individual problem record, to make the 


necessary#correction: 


Geo eeLrans. CeELLoLs 


Errors in the public transit route 


information were grouped according to the 


following categories: 


a) 


b) 


Route name not found in transit file. 


The first time that a route description 
which was not part of the original 
lookup file was processed, the computer 
simply flagged it as an invalid route. 
The route description was automatically 
added to the lookup file as an alias 
route description. Common misspellings 
such as the "Eglington" East Bus route 
or the "Young" Subway fell into this 


category. 


Route name matched to an alias with no 


route number code. 
When a route description was processed 


that had previously been added to the 
lookup file but had not yet been 
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c) 


assigned a route number code, the 
computer software altered the previous 
message to indicate that a matching 
alias route description existed in the 
lookup file but had not yet been 
assigned a route number code. In 
certain instances of misspelled route 
descriptions, the coder assigned the 
correct route number code. 
Subsequently, all route descriptions 
that matched this alias exactly would 


be processed automatically. 


In other instances, the alias route 
descriptions were not sufficient to 
allow a route number code to be 
assigned. For example, the alias route 
description FINCH is not complete. The 
coder would refer to the interview form 
and determine whether the respondent 
was referring to the 39-FINCH EAST bus 
route or the 36-FINCH WEST bus route. 
The record in question would 


subsequently be edited. 


Transfer between routes which do not 


meet. 


When more than one transit route was 
used on a trip, the computer software 
automatically referred to another look- 
up file and checked whether or not the 
various routes intersected with each 
other. This file of intersecting 
routes was created prior to 
commencement of the survey. If a trip 
record contained an error in this 
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class, the coder would first determine 
from appropriate reference material 
that the routes in question do or do 
not connect. If the connection was 


valid, the lookup file was updated. 
Summary Statistics 


The Survey respondents reported their trip ends 


by the following categories: 


Type Per Cent 
Ore lOotal 
Home Addresses 44% 
Detailed Street Addresses 
for non-home locations 8% 
Monuments 30% 
Intersections 18% 


Setting aside the home addresses, it is worth 
noting that over half (53%) of the trip ends were 
reported as monuments, compared to almost one 
third (32%) as intersections and a small 


proportion (15%) as detailed street addresses. 


The success of the computerized geocoding 
technique varied by type of lookup as illustrated 
in the table below: 


Type Success Rate 
Home Addresses 76% 
Monuments 37% 
Intersections 60% 
Non-Home Addresses 45% 


GE ss 


The success rate for home addresses was not 
higher because of a high rate of data entry 
errors and because the descriptions were mailing 
addresses which are not always sufficient for 
geocoding, particularly in the case of rural 


routes or postal boxes. 


The monument file was continually added to 
throughout the survey. Initially the success 
rate was only around 10% because of the 
inadequacy of the initial monument files, but by 
the end of October it improved and levelled off 
at almost 40%. Thereafter the look-ups were 
mainly affected by the large number of spelling 
errors entered by both interviewers and data 


entry operators. 


The software was designed to allow alias names to 
be entered into the AMF; however, the statistics 
discussed here relate to first attempts at 
returning coordinates. Other factors which 


affect the statistics include the following: 


Cz) Trip ends outside the GTA and in Caledon 
were not, included in the AMF. 

(ii) the AMF itself contains errors, omissions, 
ectcu, 

(iii) the AMF's were one to five years old; . 
therefore, new subdivisions and other new 


development would not be included. 


The automatic creation of alias street names in 
the AMF resulted in a 20% improvement in the 
lookup rate for intersections (from about 40% to 
about 60%) and non-home addresses (from around 
20% to around 40%) by the end of the survey 


period. 
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Transit route number codes were also 
automatically assigned. At the beginning of the 
survey, when coders were not fully aware of all 
unique routes in the GTA, the success rate was 
low, but by the end of the survey it improved to 
over 60%. Besides spelling errors in the route 
descriptions, the system had to deal with 
different nomenclature for the same route. For 
example, the Bay Trolley Coach route was 
described in almost 50 different ways (Bay 
Trolley Car, Bay Trolley, Bay-6, Bay Street 


route;wBay Bus ,#etc. )% 


As mentioned earlier, a file that described 
routes which intersect with each other was 
maintained throughout the survey so that checks 
were performed automatically. The success rate 
here also improved from approximately 50% early 
in the survey to better than 80% by the end. 
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SURVEY COSTS 


5.1 


Pilot Survey Costs 


The Pilot Survey was funded by the MTC and 
carried out by a contractor for a total fee of 
$37,000. Almost 1500 households were interviewed 
during the nine day survey at an average cost of 
approximately $25 per household. The objectives 
of the Pilot Survey were to test various survey 
design features, not to maximize productivity. 
The survey had high "up front" costs and 
management overhead costs (including the need for 
extensive documentation), resulting in the $25 


figure. 
Survey Budget 


During the preliminary planning for the survey, 
it was estimated that approximately $600,000 to 
$800,000 (in addition to in-house staff and 
services) would be required to carry out the work 
which was envisaged. In the early discussions it 
was uncertain whether the Ministry of 
Transportation and Communications would fund 50% 
or 75% of the total cost. There was a consensus, 
however, on the cost sharing arrangement between 
the participating upper tier municipal 
governments - costs would be proportioned 
according to population. Within Metropolitan 
Toronto there was a further agreement between the 
Metro Planning Department and the Toronto Transit 


Commission to share Metro's levy evenly. 
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Agency Cost-Sharing 
——— Percentage 
Durham 4 


Halton 1.64 
Hamilton-Wentworth 200 
Metropolitan Toronto 6.66 
Ministry of Transportation 
and Communications 75200 
Peel BrioU 
Toronto Transit Commission 6.66 
York ; 2x. 00: 
100.00 


The range of potential costs formed the basis of 
the 1986 budget requests submitted by the 
participating agencies to their respective 
Councils and Commission. Subsequently the 
Ministry advised that it was prepared to fund 75% 
of the cost to a maximum total cost of $800,000. 
Most of the agencies had already received budget 
approval for sufficient funds to cover at least 
25% of their share of the $800,000. As a result, 
$800,000 became the level of funding which was 
considered to be available during 1986 for the 
survey, and all subsequent detailed planning was 


undertaken within that framework. 


Based on data available from similar surveys in 
Montreal and Vancouver, and on the experience of 
some of the participating agencies in the Toronto 
area, detailed budget estimates were prepared for 
a wide range of alternative assumptions, 
particularly with respect to sample size and 
interviewer productivity. With respect to sample 
size, estimates were prepared for six different 
levels ranging from 3.5% to 6.0% of households; 
in the case of interviewer productivity, the 
analysis included eight different rates, ranging 


from 2.5 interviews per interviewer per hour to 
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6.0 interviews per interviewer per hour. 

Detailed budgets were prepared for 48 different 
Scenarios; furthermore, consideration was given 
COMthescostuimpacesotsothervimportant factors 
dealing with survey methodology (e.g. 
conventional pencil and paper versus computerized 
direct data entry methods; and whether the survey 
would be run from one central location in 


Toronto, or split between Toronto and Hamilton). 


The resulting cost estimates were plotted 
according to sample size and interviewer rate (on 
a chart which has interviewing rate as the X-axis 
and sample size as the Y-axis). Exhibit 5.1 
shows the isocost lines which were derived from 
the plotted cost estimates. Exhibit 5.1 suggests 
that, for example, a budget of $800,000 would be 
adequate for a 5% sample if the interviewers are 
able to conduct 4.9 interviews per hour. Since 
Montreal and Vancouver achieved 6.0 and 4.5 
interviews per hour per interviewer respectively, 
it was assumed that it would be possible to 
achieve at least 4.0 interviews per hour per 
interviewer in Toronto; at this level of 
productivity, $800,000 should be adequate to 


produce a sample of at least 4.0%. 


Table 5.1 shows the preliminary budget which 
formed the basis of planning for the field work. 
It should be noted that it was assumed that in 
addition to the out-of-pocket costs shown in 
Table 5.1, the participating agencies would 
contribute in-house expertise and supplies and 
services wherever possible, but especially in the 
area of coding origin and destination data and 


transit route information. 
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TABLE 5.1 


PRELIMINARY BUDGET BY MAJOR ACTIVITY 


Activity | Cost 
Administration $135,000 
Data Processing | 145,000 
Interviewing 

Interviewers/Supervisors $250,000 

Equipment, Supplies, etc. 130,000 380,000 
Editing/Coding 40,000 
Allowance for Trip Diary 50,000 
Sub-Total 750,000 
Contingency. 50,000 
TOTAL! $800,000 


In addition to this cost, it was assumed that the 
participating agencies would contribute supplies, 
services, and manpower as needed, especially staff for 
coding trip origins and destinations and transit’ route 
information. 
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The budget was refined as the project proceeded 
(see Tablee5e2).  fnertirst adjustment was made 
after the telephone interview contractor had been 
selected and the contractor costs had been 
determined. This adjusted budget was very 
Similar to the preliminary budget (Table 5.1), 
with funds for all tasks falling within the 
contractor's area of responsibility being 
consolidated into one large amount ($580,000 
including contingency funds). As the magnitude 
of the geocoding task became evident, the budget 
was adjusted again by reallocating funds from the 
Trip Diary Survey and from contingencies to 


increase the geocoding budget to $110,000. 


Telephone Interview Contractor Costs 


The agreement with the telephone interview 


contractor stipulated a contract cost of $485,000 


waseshown inéTable 523. ~This inc. udediags227 000 


contribution towards the geocoding operation. 
The per household cost of the field work 
(excluding the geocoding) was budgeted at $7.72. 
The actual final payments to the contractor 
totalled over $503,000 for 61,708 completed 
households; it is estimated that the client 
agencies contributed approximately $20,000 worth 
of free supplies and services to the telephone 
interviewing effort (e.g. envelopes, letterhead, 
office space in Hamilton and miscellaneous 
others). If these supplies and services are 
added to the total, the cost for the field work 
(excluding all geocoding costs) would be a little 
over $500,000 ($501,000), or $8.12 per completed 
household. 
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TABLE 5.2 


ADJUSTED BUDGET BY ACTIVITY 


Activity Budget 


1 


lst Adjustment 2nd Adjustment“ 


Administration $88,000 $88,000 


Telephone Interviewing 


Gontracton (incl. Contingency) 580,000 529,500 
Coding 110,000 
Software Development 44,000 44,000 
Trip Diary Survey 60,000 2700 
Other Costs 28,000 28,000 
TOTAL: $800,000 $800,000 
1 


The first adjustment to the budget was made after the telephone 
interview contractor had been selected and the contract costs had 
been determined. 


The second adjustment to the budget was made as the geocoding 
requirements became evident. 
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TABLE 5.3 


TELEPHONE INTERVIEW SURVEY CONTRACTOR COSTS 


Activity Contractor Budget Actual Cost Including 
Client Contributionl 
Amount Unit Cost Amount Unit Cost 
Interviewing 
Interviewers'/ 
Supervisors' Wages $230,000 Rec ail 
Equipment, Supplies, 88,000 1 48 
etc. he gah 
Sub-Total (Interviewing) 318,000 sia we) $346,000 $5 oa) 
Advance Letter 50,000 0.85 60,000 O97 
Data Entry 70,000 Pale 70,000 Lets 
Administration 257000 OFA? 25,000 O41 
Total (All but geocoding) 463,000 nb, 501,000 ahaa 
Contribution to Geocoding 22000) n/a n/a n/a 
Grand Total: $485,000 n/a n/a n/a 


1 Estimated distribution of contractor costs and the supplies and 
services provided by client agencies. 
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Geocoding Costs 


The total geocoding cost of $301,000 is itemized 
in Table 5.4. It should be noted that these 
geocoding costs also include the cost of coding 
the transit route data. The direct costs of the 
geocoding operation totalled $220,000, with an 
additional $22,000 being included in the 
telephone survey contractor's budget and almost 
$60,000 being received in the form of manpower 


and equipment contributions from client agencies. 


The cost of the geocoding was approximately 80 
cents per trip with the direct cost being close 


to 60 cents per trip. 
Other Indirect Costs 


In addition to the indirect costs noted with 
respect to geocoding and the telephone 
interviewing field operations, there were other 
indirect costs borne by the participating 
agencies. They included staff time and/or 
equipment or services provided by the agencies 


without billing the Survey. 


In addition to the staff provided to help with 
the geocoding, the agencies provided professional 
and technical staff to carry out special 
assignments in the planning and implementation of 


the Survey. 


The types of services and/or supplies provided hy 


the agencies included the following: 


i) Drafting and graphic design services (TTC 
and MTC). 
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TABLE 5.4 


GEOCODING COSTS 


Activity Funded By Contrib's Included Total 
TTS from in Con- 
Agencies tractor's 
Costs 
Software Development $28,000 $10,000 - $38,000 
Hardware Leasing 15,000 2,000 $7,000 24,000 
Staff plies: 161,000 47,000 15,000 - 2257000" 
Other 16,000 - - 16,000 
TOTAL: $220,000 $59,000 $22,000 $301,000 
Cost per Household ( 61,708 households) $4.88 
Cost per Person (171,904 people) Slo 
Cost per Trip (370,919 trips) $0.81 


oa 


11) Publicity and public relations services 
(TTC and others) 

iii) Financial support services (Metro) 

(iv) Staff to carry out special research and 
other assignments (Metro, MTC, TTC, Peel, 
York, GO) 


These are in addition to the contributions such 
as office space (Hamilton-Wentworth), printing of 
letterhead (TTC), geocoding software development 
(MTC) and hardware loans (MTC) which were already 


accounted for in previous sections. 


While it is difficult to attach monetary values 
to some of the indirect costs, others can be 
estimated relatively easily. No attempt has been 
made to attach a dollar value to senior staff 
time, but professional/technical staff time is 
estimated to have been worth $15,000-$25,000 to 
the project. Other indirect costs are estimated 


to have been worth another $10,000. 
Summary of Costs 


Table 5.5 shows a summary of all costs associated 
with the conduct of the Transportation Tomorrow 
Survey field surveys, including the Trip Diary 
Survey in addition to the telephone survey. The 
total cost of $1,043,000 consists of $992,000 for 
the telephone survey and $51,000 for the Trip 


Diary. 


At $992,000, the telephone survey cost 
approximately $16 per completed household ($15 
per completed household for direct costs). These 
costs do not include subsequent costs for 


processing and analysing the data. 
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TABLE 5.5 


1 


SUMMARY OF ACTUAL COSTS 


Activity 
Administration 
as Pilot survey 
re Telephone Interviews 
4, Geocoding 
She Other 


Sub-Total: 
eh Trip Dlany 


TOTAL: 


$1, 


Amount 


$88,000 
37,000 
501,000 
301,000 
65,000 
992,000 
51,000 


043,000 


Cost/Completed 
Household 


1 this summarizes all costs, including indirect costs (goods, 
services and manpower provided by individual agencies) and special 
funding provided by the Ministry of Transportation and 
Communications for the Pilot Survey and the Trip Diary Survey. 


with the specific activities above 


relations). 
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This category includes direct and indirect costs not associated 


(e.g. publicity and public 


6. CONCLUSIONS AND RECOMMENDATIONS 


This section presents the conclusions which can be 
drawn about how the survey was carried out and the 
recommendations on how to improve the process in 
subsequent Surveys. Some of the conclusions and 
recommendations must be considered preliminary or 
tentative because only in-depth analysis of the 
tabulations of the survey responses will show how well 


the survey process achieved its goals. 
6.1 Telephone Surveys 


In general, the telephone interview technique 
proved itself to be a very cost effective method 
of collecting household travel information. 
Costs are very comparable to "mail-out, mail- 
back" surveys, while respondent response rates 
are higher. It remains to be seen whether the 
quality of response (i.e. trip rates reflecting 
trip recall) is equivalent to the mail-back trip 
diary method, but indications are that telephone 
surveys collect at least peak period trips as 


well as mail-back trip diaries. 
6.2 Sample 


Bell's telephone listings appears to be a good 
source for drawing the sample for a travel 
survey. However, there were problems with the 
sample drawn for the Transportation Tomorrow 
Survey due to various reasons. These sorts of 
problems can be avoided by taking the following 


action in future: 


i) The Survey Work Group should participate 


directly in the sample draw discussions 


me teh = 


with Bell; the instructions to Bell and 
their confirmation should be in writing 
with all participating agencies receiving a 


copy of this documentation. 


ii) The sample from Bell should include certain 
summary statistics about the number of 
records included by municipality, by postal 
code (or by the first: threesdigits. of the 
postal code) and by any other category 


which may be of interest. 


iii) Sufficient time (e.g. two weeks or more) 
should be scheduled into the work program 
for a detailed analysis of the sample by 
the Survey Work Group and the individual 


agencies. 


Direct Data Entry 


~The decision to not risk proceeding with a 


direct data entry (or CATI) methodology to carry 
out the Survey in 1986 was almost certainly a 
very wise move. Several aspects of the proposed 
system were unproven and the Survey Work Group 
had legitimate reason for being concerned about 
introducing too many potential problems into 


such a large project. 


However, it was evident from the Pilot Survey 
that a direct data entry method was highly 
desirable, and experience with the 1986 Survey 
confirmed this. An automated approach would not 
only eliminate the paper handling and the extra 
step involving data entry, but would permit 
almost instantaneous progress reports and 


calling statistics (e.g. refusal rates). 
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It is recommended that any future survey give 
serious consideration to using direct data 
entry. Furthermore, it is recommended that the 
direct data entry system consist of a full 
screen representation of the entire 
questionnaire with full screen editing 
Capabilities, as opposed to the CATI systems 
used by market research firms. The CATI 
approach, a page by page system, is tailored to 
the highly structured interviews common to 
marketing research surveys; this approach is 
unsuited to travel surveys where it is important 
for the interviewer to get an overall 
understanding of the household's activity 
pattern and to probe for trips which the 


respondent may have forgotten to mention. 
Marketing Research Industry 


During the course of the Transportation Tomorrow 
Survey, the Survey Work Group had extensive 
exposure to the market research industry. The 
Work Group reviewed written proposals from 
numerous firms, visited the premises of several 
companies, interviewed some of them and worked 
with three different firms (Pilot Survey, main 


survey and Trip Diary Survey). 


A small number of companies appear to have some 
excellent staff at the professional and 
technical level, but this is not an industry 
norm. Also, due to the highly competitive 
nature of the industry in vying for the routine 
marketing surveys which account for much of the 
industry's income, all firms are highly 
sensitive to keeping labour costs to an industry 


Minimum. While this results in a lower quality 


me yc 


interviewer, “it is not ‘critical ‘to“the types of 
surveys conducted by market research firms. 
There 1s not a great deal of skill required on 
the part of the interviewer because the 
questionnaires tend to be highly structured with 
respondents giving "yes/no" answers or choosing 


a response from a multiple choice list. 


It is therefore recommended that future surveys 
not necessarily rely on the market research 
industrytoy carry out they field: work. = Equal 
consideration should be given to some of the 
other possibilities described in Section 6.6 


below. 
Quality of Telephone Interviewing Staff 


The contractor had difficulty attracting enough 
capable interviewers to staff the 72 telephones. 
The shortage may have resulted from a number of 
factors, including an overly optimistic estimate 
of the labour supply by the contractor and the 
impact of an upSurge in the Toronto economy 
which caused service industries to use up the 
low wage labour pool. Whatever the cause, the 
shortage affected the quality of the travel data 
in a number of ways. The shortage of applicants 
meant that hiring standards were lowered and 
more marginal interviewers were retained on 
staff. In particular, there were some 
interviewers with very poor general knowledge 
about places and transit services within the 
Survey area, and displayed poor spelling and 
handwriting. The shortage also meant that 
Supervisors had to resort to pleading with 
interviewers to come in to work more often. 


Under the circumstances it was very difficult 


- 84 - 


for supervisors to impose higher quality and/or 
productivity standards on the interviewing 
staff. While there were some excellent 
interviewers and most were at least 
satisfactory, marginal performers managed to 
stay on the job because there was nobody better 


to take their place. 


It was apparent that a higher hourly rate was 
needed to attract more potential interviewers of 
higher caliber. Since the mark-up on market 
research company interviewers is typically in 
the range of 100%, it would cost two dollars to 
put an extra dollar into the hands of the 
interviewer. It would be possible to increase 
the actual hourly pay to interviewers without 
increasing the cost of the survey if the mark-up 
is reduced, or if the survey is conducted under 
a different arrangement with the agencies © 
assuming a greater role in administering and 
directing the project. Taking on greater 
responsibility also means assuming a greater 
risk in the event of complications and over- 


runs. 


When planning future surveys, it is recommended 
that an interviewer hourly wage rate be 
established at the outset by the Survey Work 
Group. This will probably require some research 
and analysis in the Toronto workplace, as well 
as getting input from Montreal and elsewhere. 

It should be significantly higher than the 
prevailing marketing research interviewer rates, 


possibly 50% higher. 


= @F < 


Contract Out vs. In-House 


Starting with the wage rate established as per 
the recommendation in Section 6.5 above, the 


following options should be explored: 


1%) Conduct the survey totally in-house. By 
planning well in advance, it may prove 
feasible to assign a few professional and 
technical staff to the project from within 
the agencies to direct and manage the 
preparations and the implementation of the 
survey. One of the agencies would have to 
assume a lead role in terms of being the 
hiring and payroll agency for temporary 
staff. 


ii) Conduct the survey in-house, but use 
outside firms to perform specific services. 
For example, an "office overload" type of 
firm might be engaged to recruit 
interviewers who would nominally stay on 
the payroll of the recruiting company which 


would bill monthly on a cost plus basis. 


iii) Use a contractor/consultant in a similar 


Capacity as in 1986. 


It is recommended that all three avenues be 
explored. A decision will need to be made on the 
total in-house approach early in the planning 
(perhaps a year before); if this option is 
selected then the other two are immediately 
discarded. If the total in-house option turns 
out to be impractical, the second and third 
options can both be retained as options up to 


the point of selecting a contractor/consultant. 
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Geocoding 


The geocoding was the one aspect of the Survey 
which was essentially carried out in-house under 
the complete direction of the Survey Work Group; 
it proved to be very successful. The hardware 
and software performed well and it proved 
possible to recruit at moderate cost a 
sufficient number of high quality temporary 


employees to operate the system. 


The system proved itself to be cost effective 
compared to manual coding to traffic zones, 
while providing a better quality product in 
terms of precision and future flexibility. 
Being a new system, there were obvious areas of 
improvement identified. Some of these 
improvements have already been implemented in 
subsequent work, but there is a need to explore 


further improvements. 


It is recommended that the geocoding system 
continue to be developed and enhanced with a 
view to improving its performance while reducing 
costs. Improvements would include changes to 
permit use of the system on industry standard 
microcomputers, and greater emphasis on the 


following in training interviewers: 


a) Use of monuments in describing trip ends. 


ii) Use of well defined recording conventions 


for addresses, monuments and intersections. 


——oe, 


Other Recommendations 


The following miscellaneous recommendations are 


documented for consideration in planning any 


future survey: 


i) 


isis) 


11518) 


iv) 


v) 


Invorder*tomenhance™thes ability toMattract 
interviewers, the survey operations should 
be established at a central location with 
good transit access in the evenings (in the 
Toronto context, being within walking 
distance of a subway station would be 


highly desirable) ; 


With direct data entry, paper forms will 
play a much less important role in future. 
However, if paper forms are used, they 
should be designed with the data flow 
requirements~-in mind to enhance the ease of 


use and to minimize the chance of error. 


The system must allow the direct electronic 
transfer of household data (i.e. address) 
from the sample file to the completed 


interview record. 


If direct data entry is not employed, then 
data entry should be carried out by 
professional data entry personnel with 100% 
verification and a computerized tracking 


and reporting system should be implemented. 


Most major telephone travel surveys have 
been content with making three attempts to 
contact each household. The Transportation 
Tomorrow Survey required five attempts; 


the fourth and fifth attempts were 


=O ie 


responsible for approximately 12% of the 
final total of completed interviews. The 
merits of retaining the fourth and fifth 
attempts in future surveys will need to be 
assessed from a detailed analysis of the 
data produced by these additional attempts. 
The initial reaction, however, would be to 
recommend retaining the five attempts, 
except 1f it can be shown that these 
attempts make no significant contribution 
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Exhibit A 
SUMMARY AND RECOMMENDATIONS 


General Conclusions 


The overall conclusion that is reached about the Pilot 
Study is that it accomplished the goals originally set 
out. Research instruments were designed and thoroughly 
tested, the advance letter was produced, distributed and 
its effects monitored, the sampling method was tested 
under field conditions and different methods of data 
entry were tried. There certainly were difficulties 
encountered during the project, but it is the nature of a 
pilot study to create problems in order to discover or 
invent solutions. 


Many of the problems that occurred during the Pilot Study 
were the direct result of employing untested methods or 
using new suppliers at the beginning stages of the 
project. Whenever new suppliers or methods are employed, 
more than ample time should be allotted to the task in 
case of problems. 


Once the Pilot Study went into the field, the 
difficulties largely subsided. Environics' interviewers 
adjusted to the open-ended format of the questionnaire 
and proceeded to collect high quality data. In fact, the 
extremely high response rate of the Pilot Study has 
indicated that the overall design and the instruments 
were sound. 


Specific Recommendations 
2.1 Use of the Return Trip 


Various phases of the Pilot Study were tested with 
and without the use of the Return Trip. During the 
first week of the Pilot Study (Days 1 through 6), 
the Return Trip was used even if both legs of the 
trip were not connected. For Days 7 through 9, the 
Return Trip was dropped altogether as respondents 
were asked to report on individual trips ina 
consecutive fashion. 


When the Return Trip was being used, the average 
number of trips recorded per household was 6.7 
trips. When the Return Trip was eliminated, the 
average number of trips recorded was 5.7 trips per 
household. Although dropping the Return Trip 
intuitively was thought to increase the number of 
trips recorded (trips were recorded sequentially so 


there was less of a likelihood of skipping a trip), 
on average, 1 more trip per household was recorded 
using the Return Trip design. 


The recommendation, therefore, is to continue to use 
the "Return. Trip =) ther conceptyor returnings toma 
previous origin may have helped respondents to 
reconstruct their previous day's travel patterns, 
while the sequential questioning ("Where did you go 
next?") did not. Whether or not to use the 
sequential Return Trip (next trip had to be the 
return) or the out-of-sequence Return Trip (used in 
the first week of interviewing) cannot be addressed 
because the two were not empirically tested. 
Whichever is to be used in the future, it should be 
kept in mind that interviewers should not be placed 
in the position of having to make definitional 
decisions as to what is a Return Trip by having to 
backtrack through previous portions of an interview 
while they are interviewing. 


3h, Evaluation of the Effectiveness of the Trip Log 


Ss ysal 


Positive Elements 


When analyses are undertaken at the individual- 
level, the trip log appears to indicate an under- 
reporting of out-of-home trips among households just 
receiving the advance letter and a telephone call on 
an unspecified date. When respondents complete the 
trip log, an additional two trips per household are 
reported. It is very likely that these extra two 
trips are a result of the trip log because the 
household size of the group completing the trip log 
and the group receiving the trip log but not 
completing it is identical. 


Negative Elements 


Although the information from the trip log is most 
likely more accurate, it is obtained at high cost. 
First, the major and most serious drawback of the 
use of the trip log is the extremely low completion 
rate (22%). The low completion rate cannot address 
the question whether households making a greater 
number of trips simply were more likely to fill out 
the trip log. (Did the trip log produce more 
recorded trips or did households who travelled more 
frequently complete the trip log more often?). 


Second, the administrative overhead of inserting a 
specific date for recording travel and for 
interviewing is high. As already found, the 
probability of making mistakes increases with the 


necessity of specifying dates. Third, the 
coordination between mailing and interviewing must 
be very precise. This is, all the calls for a 
particular night must be made. This scheduling 
requires the accurate prediction of how many 
respondents can be reached on a designated evening. 
Therew Seri tc lesroom tor, error. ~Fourth;, there is no 
Saving in the amount of time to retrieve information 
from respondents. In fact, the extra trips that are 
recorded require additional time to retrieve. 


Direct Data Entry 


First, Environics did not compile any .,productivity data 
about the performance of the four interviewers who 
directly entered data onto a microcomputer. The 
recommendations are based on the debriefing questionnaire 
and comparisons between the paper and electronic data 
entry methods. Second, it should be kept in mind that 
four interviewers working for 9 days is a limited test of 
a new system and its reliability. 


Microcomputer data entry during the Pilot Study is best 
regarded as a test of a prototype system. There are 
facets of the prototype that worked (the use of the 
function keys for home and previous origin) and aspects _ 
that need more work (editing features). Improvements to 
the prototype should be made before the final "production 
model" is released. 


The major criticism of direct data entry is the current 
inability of the system to allow verification of the work 
of interviewers as it is being completed. Each paper 
questionnaire and coding sheet is checked by supervisors 
for completeness and logical consistency as interviews 
are completed. If supervisors were able to interactively 
examine and correct the work that has been entered, 
electronic data entry would be comparable to manual 
entry. An interactive supervisory system may necessitate 
the use of microcomputers connected into a local area 
network (LAN) with a central file server or possibly a 
move to even more powerful systems. 


One final note about electronic data entry. Since street 
names and addresses are being keyed, interviewers will 
have to have at least minimal typing skills. This may 
raise the cost of finding and hiring qualified 
interviewers. 


Should a large number of revisions be made to the data 
entry system, either in its hardware or software 
configurations, these changes will have to be field 
tested. That is, another pilot study will have to be 
mounted before the main study is to go in the field. 
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Exhibit B 


Ontario ADVANCE LETTER 


Ministry of 
Transportation and 
Communications 


February 27, 1986 


Dear Sir/Madame, 


To ensure continued improvements to road and transit services 
in Metropolitan Toronto, Hamilton-Wentworth, Durham, York, 
Peel and Halton Regions, this Ministry, in cooperation with 
the Regional governments and transit agencies, is planning to 
undertake a survey of travel patterns. First, though, we 
would like to make sure that our proposed survey is easy to 
understand and will not take much time to complete. We are 
asking for your help in testing the method which we intend to 
use in the full survey. 


Within the next few days, an interviewer will call and ask to 
speak to you or another adult resident. They will be phoning 
on weeknights between 5:30 and 10:00 in the evening or on 
Saturdays between noon and 6:00 PM, and Sundays between 1:00 
and 6:00 PM. Interviewers will ask questions about travel 
undertaken by the members of your household for the day 
before. Examples of the questions are: When did you make 
your trip?, By what means did you get there?, and What was 
the purpose of your trip (work, shopping, recreation, etc.)? 


All information gathered will be kept absolutely confiden- 
tial; we will only be looking at the total results from an 
entire cammunity in order to get a picture of the overall 
travel patterns from area to area. 


The interviews are being conducted by Environics Research 
Group, an independent survey research company. If you have 
any questions about the survey, please call John Dixon at 
Environics in Toronto, 964-1397, or contact Public and Safety 
Information Branch of my Ministry at 248-3501 or 1-800-268- 
0637 for long distance. 


I would like to express my personal thanks for your assis- 
tance in this project. By helping us now, we will be able to 
serve you better in the future. 


Yours truly, 


David Hobbs, 
Deputy Minister 
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Exhibit D 
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Exhibit E 


LENGTH OF INTERVIEW AND NUMBER 
OF TRIPS 


Lees thon 10 
households 


REGRESSION UNE 
Siope = .72 min./trip 
intercept = 4.40 min. 


AVERAGE LENGTH OF INTERVIEW (minutes) 
at 


0123 45 6 7 8 9 101112131415 16 17 1819 2021 22232425 
NUMBER OF TRIPS 


Exhibit F 


COMPARISON OF HOUSEHOLDS RECEIVING AND 
NOT RECEIVING TRIP LOGS 


AVERAGE NUMBER OF TRIPS RECORDED 


Households ‘completing the trip log (N=61) See strips 

Households receiving log but not 

completing it (N=214) = 5.7 trips 

Households not peceiing thegtripnlogs (N=/31.)e— 6, 0mtriaps 
AVERAGE SIZE OF HOUSEHOLD 

Households completing the trip log = 2.4 people 

Householods receiving log but not 

completing it = 2.4 people 

Households not receiving the trip log = 3.0 people 
AVERAGE TIME OF INTERVIEW 

Households completing the trip log = 8.7 minutes 

Households receiving log but not 

completing it = 7.3 minutes 


Households not receiving the trip log = 9.5 minutes 
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Exhibit G 
COMPLETION DATA 


TOTAL 
Completed interviews 10 tee 
Language barriers 18 
Incomplete interviews 23 
Refusals 180 
Not eligible y 
Not in service ie 
Not available ao 
No answer 85 
Total numbers in circulation? 1431 
Total eligible contacts” P2383 
Refusal rate? 15% 
Response rate’ 82% 
Completion rate” 71% 
Completions per interviewer hour® PA 


Sum of all completed categories 

Completed + language + incomplete + refusals 
Refusals/total eligible contacts 
Completed/total eligible contacts 
Completed/total numbers in circulation 
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Completed/total hours of interviewing 
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APPENDIX B 


TERMS OF REFERENCE 


an 
an 


re th eget" rh ae sihene a rors . 


HOUSEHOLD TRAVEL BEHAVIOUR SURVEY 
FOR THE GREATER TORONTO AREA 


TERMS OF REFERENCE FOR CONTRACTORS 


tke INTRODUCTION 


1.1 


Background 


The Ministry-of Transportation and Communications, 
Metropolitan ROreonta? the Toronto Transit 
Commission, and the Regional Municipalities of 
Durham, York, Peel, Halton and Hamilton/Wentworth 
have for a number of years coordinated their 
activities in travel data collection through a 
committee called the Toronto Area Transportation 
Planning Data Collection Steering Committee 
(TATPDCSC). The participating agencies have decided 
to conduct an extensive survey of travel patterns in 
the Greater Toronto Area in the Fall of 1986. 


To date the TATPDCSC has retained a General Manager 
to direct the Survey and has conducted a Pilot 
Survey with almost fifteen hundred households. The 
Pilot was carried out by the Environics Research 
Group during March, 1986, to test the design of the 
questionnaire and the general methodology. A report 
on the Pilot Survey was prepared by Environics and a 
copy of this document is available upon request from 
the General Manager. 


At this time the TATPDCSC is prepared to entertain 
proposals from survey companies individually, or in 
consortia, for carrying out the interviewing and 
certain associated tasks as per this Terms of 
Reference. Proposals should be submitted to the 
General Manager, 3rd Floor, West Tower, Ministry of 
Transportation and Communications, Downsview, by 
4:00 PM on June 23, 1986. 


Overview of the Scope of the Work 
Exhibit A shows the organizational structure of the 
Survey, and designates approximately the work which 


is expected to be contracted out. 


The project consists of one large Household 
Telephone Survey (Part A of the detailed 


specifications) and an optional smaller Trip Diary 


Survey (Part B of the detailed specifications). The 
Contractors responsibility will be limited 
generally to carrying out the field work, while the 
TATPDCSC will retain responsibility for the sample 
design, the questionnaire design, the logic checks, 
the validation of the survey results and the 
subsequent analysis of the data. 


Copies of the Household Telephone Survey 
questionnaire (as originally specified by the 
TATPDCSC and as interpreted by Environics for the 
Pilot) are attached as Append1xUB..) bt 91s sexpected 
that the Survey will consist of completed interviews 
with a minimum of 60,000 households, possibly as 
many as 75,000 households. The sample (designed by 
the TATPDCSC) will be obtained by the Contractor 
from Tele-Direct (a subsidiary of Bell Canada). 


In addition to the actual telephone interviewing, 
the Contractor's responsibilities will ~ include 
mailing out advance letters, performing certain 
checks on completed interviews, correcting the 
interview data, and delivering a complete, "clean" 
file of the completed interviews on computer tape or 
disk. 


The TATPDCSC also wishes to carry out a parallel 
Trip Diary Survey as part of the same contract. A 
decision on this Survey will. be based on -the 
availability of funds. A mail-out and mail-back 
survey is proposed with a questionnaire which is 
similar to the Household Telephone Survey 
questionnaire, but more detailed in terms of 
demographic questions and possibly covering all 
household travel on more than one day. Telephone 
contact would be required to remind people to keep a 
record on the requested day(s), to remind people to 
mail the diaries back and to follow up on non- 
response. It is expected that the sample size will 
be complete interviews with a minimum of 2,500 to 
5,000 households. 


PAE 


PART A: HOUSEHOLD TELEPHONE SURVEY 


2.1 


Timing 


All interviewing is to be done no earlier than 
September 15, 1986, and no later than December 5, 
1986.. The interviewing must cover travel on Mondays 
through Fridays equally (normal working days only), 
and no interviewing should be done after 10:00 PM. 


Chief Supervisor 


It iS a prerequisite that the person proposed by the 
Contractor for the position of Chief Supervisor be a 
person with direct relevant experience in 
Supervising a sizable telephone home interview 
travel survey. The curriculum vitae of the proposed 
Chief Supervisor should be included in the Proposal. 


Questionnaire 


The finalization of the design of the questionnaire, 
and the structure of the interview will be the 
responsibility of the TATPDCSC. It is expected that 
the questionnaire will change only marginally from 
the Pilot Survey. However, any suggestions from the 
Contractor will be considered. 


Sample 


The TATPDCSC will be responsible for the sample 
design and will provide the Contractor with the 
specifications. The Contractor will be responsible 
for procuring the sample from Tele-Direct or a 
Satisfactory alternative source. 


The sample drawn will be based on an expected 
completion rate of approximately 70%. The Pilot 
Survey had a completion rate of 71% (82% of eligible 
households), while a similar survey in Montreal has 
experienced completion rates of approximately 68% 
(79% of eligible households). 


Advance Letters 


The Contractor will be responsible for arranging the 
printing and mailing of personalized letters to each 
household on a daily basis approximately one week in 
advance of the expected telephone interview. 


The specific Micontents = of ther*letter and any 
accompanying material will be determined by the 
LTALPDCSCe 


Interviewing Languages 


The. Contractome wHll Gbes@expected™ to!’ carry out 
interviews oin. other languages in ‘addition to 
English. The  TATPDCSC “will ‘provide “official 
translations of the questionnaire in the nine 
languages, listed’ bel ow ;sthemContractor /ismeexpectecd 
to have as a minimum the following number of 
interviewers able to interview in each of the nine 
languages: 


Language No. of Interviewers 


Italian 
Portuguese 
Spanish 
German 
Greek 
Cantonese 
French 
Polish 
Ukrainian 
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The languages and the number of interviewers are 
subject to change as the Survey proceeds and 
conditions warrant. The TATPDCSC will provide any 
new translations which may be required. 


Rates of Pay 


The TATPDCSC is concerned about the quality of staff 
and the . turnover in staff (particularly 
interviewers, but also supervisors and others) who 
will be employed by the Contractor to carry out the 
Survey. The rates of pay and any incentive plan 
will have a bearing on a Contractor's ability to 
attract and retain good personnel. 


It iS a requirement that the proposed rates be 
listed in the prcecposal. Any incentive plan for 
minimizing turnover should be described in the 
proposal. 


Staff Training 


The TATPDCSC considers training of the interviewers 
and their supervisors, and the checkers, correctors 
andsrcoders “toyibe ®icritical’ tothe ‘success *of the 
Survey. TATPDCSC personnel are to be given a 
minimum of four hours during the training process to 
instruct the Contractor's staff on the purpose of 
the Survey, the unique characteristics of conducting 
an Origin-Destination Travel Survey, and how to deal 


with a range of possible travel situations. The 
Contractor would be responsible for other aspects of 
the training, including instructions on 


administrative procedures, general instructions on 
dealing with the public, etc. 


TATPDCSC personnel will have the right to reject any 
of the staff after the training program. 


Supervision/Monitoring 


A high level of supervision and monitoring is 
expected on the Survey. A minimum of one supervisor 
to six interviewers will be required unless the 
Contractor can show valid reasons for fewer 
supervisors. = 


The proposed supervision and monitoring procedures 
Should be described in the proposal. 


Method of Recording Data 


The Ministry of Transportation and Communications 
has had a consultant study carried out on date entry 
methods and a Direct Data Entry demonstration 
project was carried out during the Pilot Survey with 
the cooperation of the Environics Research Group. 
The consultant (Professor Gerry Steuart of the 
University of Toronto) has prepared a report which 
recommends DDE, and which concludes that’ the 
software developed for the demonstration project, 
subject to some relatively minor refinements, is 
Suitable for the large Survey. Professor Steuart's 
report and the software used in the demonstration 
project are avilable on request at no cost. 


The TATPDCSC has made no commitment to the results 
of the consultant study and is willing to consider 
all proposals with respect to how the interviewers 
record the data, i.e. whether the traditional pencil 
and paper or machine readable forms are used, or 
whether CATI or other computerized direct data entry 
(DDE) systems are used. Die CONCYACCOL 1S 


Pees 


2.12 


encouraged to include more than one alternative in 
his proposal, if he is capable of carrying out the 


work using more than one technology. 


The decision on the methodology will be made on the 
basis of cost comparisons, and on the basis of the 
trade-off between improvements in the quality of 
data and the risks associated with any new 
technology. A higher cost may be acceptable if 
there is a reasonable return in terms of data 
quality. 


Transfer of Questionnaires to Electronic Medium 


All interview data must be on an electronic medium 
Suitable for computerized checking procedures to be 
carried oUt. during «the, morning “otaithe efollowing 
weekday. In the case of traditional paper 
questionnnaires, it will be necessary to arrange 
overnight keying in of the data. 


Coding 


The questionnaire will be self-coding for all but 
the origins, destinations and transfer points. The 
TATPDCSC will retain ultimate responsibility for the 
method used to code these three items, with the 
Contractor's role being limited to providing two 
full time clerks from September 2 to December 19, 
1986, inclusive. TATPDCSC personnel will train the 
coding clerks, oversee their work and assist, if 
needed, to keep pace with the work. 


The TATPDCSC expects to employ a computerized 
geocoding technique based on StatsCan's Area Master 
Files. The TATPDCSC will develop and provide the 
software; the Contractor will run the software at 
the same time as the automated checking routines 
(see Section 2.13). 


Checking and Correcting 


Automated checking of the completed questionnaires 
is to be carried out on a daily basis during the 
morning of the first weekday after the interviewing. 
The TATPDCSC will provide the . software with the 
logic checks which will be required. The checking 
must be done on a daily basis to ensure immediate 
feedback to the supervisors and monitors to rectify 
incorrect interviewing practices, and to ensure 
immediate follow-up on incomplete interviews. 


The | Contractor's  statiyewiit “4run the’ "checking 
routines, review the results, make any corrections 
which can be deduced, check with the interviewer if 
necessary, and send back to the interviewer for a 
call back if required. 


Detailed statistical records (as specified by the 
TATPDCSC) of the checking are to be provided to the 
TATPDCSC with daily and weekiy summaries. TATPDCSC 
personnel will review problem areas with the 
Contractor and agree on corrective action, including 
removal of any Contractor personnel from their 
duties. 


Callback Standards 


A minimum of five attempts will be made to contact 
every household. Busy Signals are not to be 
included as one of the five attempts. In the case 
of no answer, no more than two calls can be made on 
the same day and, in the case of two calls on the 
same day, these calls must be at least two and one 
half hours apart. 


Productivity Estimates 


In preparing cost estimates, the Contractor will 
need to estimate the number of completed interviews 
that an interviewer can achieve per hour over the 
course of the Survey period. 


The Pilot Survey achieved 2.3 completed interviews 
per hour per interviewer. A comparable survey in 
Montreal, which has been conducted several times, 
routinely achieves six completed interviews per hour 
per interviewer. A similar survey in Vancouver in 
1985 averaged 4.3 completed interviews per hour per 
interviewer. 


The low productivity rate during the Pilot Survey is 
not considered to be a valid indicator for a number 
of reasons; emphasis was placed on testing 
alternative procedures, not on the _ productivity 
rates. It is felt that a rate of 4 to 5 completed 
interviews per hour per interviewer is achieveable 
in the local setting, with the actual rate being 
dependent to some extent on the methods employed to 
record data and to manage the sample, and the 
organizational and management skills of the 
Contractor. 


2.16 Location of Interviewing 


7A EF | 


The Contractor should provide cost estimates for the 
following options: 


a) All interviewing conducted from_- one 
central location; 


b) Interviewing divided between two 
locations» — onelain. Toronto,# the other. in 
the Hamilton area; 


Sy) Any other arrangement preferred by the 
Contractor, sand, 


d) Potential cost savings, Lim aany, we 
TATPDCSC agencies provide the office space 
atanoprent. 


Final Form of Data 


The Survey data is to be delivered throughout the 
Survey period as it is "cleaned", completed and 
accepted by the TATPDCSC Quality Control personnel. 
The data is to be on magnetic tape or disk, ready 
for further computer processing. 


Cost Estimates 


The proposal should include your total itemized 
costs for the various options shown in the summary 
table on the next page. It is not necessary to 
include a cost for all methodology options, only 
those which you are prepared to undertake. However, 
please provide costs for each number of completed 
interviews for those methodologies which you are 
prepared to use. The costs should be itemized by 


major categories such as_ interviewers' wages, 
Supervisors' wages, checkers! and correctors' wages, 
coders' wages, computer costs, mailing costs, 


telephone costs, and miscellaneous other costs. 


It is also necessary to include the information 
requested in Section 2.14 concerning the impact of 
alternative locations (i.e. all interviewing 
conducted from. one central location, interviewing 
divided between a Toronto and a Hamilton location, 
any other arrangement preferred by the Contractor, 
and the potential savings, if any, if TATPDCSC 
agencies provide free office space). 


It should also be noted that the proposed wage rates 
and incentives (if any) for the interviewers and 
supervisors were requested in Section 2.7. 


SUMMARY OF REQUIREMENTS ON COSTS 


NUMBER OF METHODOLOGY 
COMPLETED 
INTERVIEWS Pencil Machine Dinect Computer 
and Readable Data Assisted 
Paper Forms Entry) Telephone 
(DDE ) Interview 
(CATI™ ) 
60,000 
65,000 
70,000 
75,000 
il 


Z 


This method refers specifically to the Direct Data Entry 
methodology developed by Professor Steuart as part of his 
demonstration project. 


This method refers to any other computer assisted telephone 
interviewing systems which a Contractor may wish to use. 


PART B: TRIP DIARY SURVEY 


Shep 


Timing 


All interviewing is to be done no earlier than 
September 15, 1986, and no later than December 5, 
1986. 


Questionnaire 


The finalization of the design of the questionnaire 
will be "theme responsibility: ‘of the ~TATPDCSC. 
However, any suggestions from the Contractor will be 
considered. 


Sample 


The TATPDCSC will be responsible for the sample 
design. The sample drawn will be based on an 
expected completion rate of approximately 70%. 


The target sample size will be completed interviews 
with 5 000 stratified households, with 2 9500 
households being the minimum acceptable number. 


Alternative Methodologies 


Since cost may have an overriding effect on the 
choice of survey design, a minimal cost method has 
been prepared in addition to the preferred method. 
These alternative methods are outlined below. 


3.4.1 Preferred Method 


The preferred method consists of a seven day 
trip diary kept by each member of a random 
sample of households which have not previously 
been called from amongst the main Household 
Telephone Survey sample. The following 
procedure would have to be followed: 


1) Telephone call to give basic information 
about the survey, ask basic questions to 
determine if household needed for 
stratified sample, seek cooperation in 
keeping a trip diary for a week, and to 
find out how many diaries are required. 


Pay) Mail out an official letter and the 
appropriate number of diaries 


3) 


4) 


5) 


6) 


7) 


approximately one week in advance. 


Telephone call night before to remind 
household members to begin keeping diaries 
following morning. 


Telephone call on evening of third day to 
give encouragement and answer questions. 


Another telephone call on evening of sixth 
day. 


Telephone call on day after end of week to 
remind people to mail in the dairies. 


If diaries not received by fifth day after 
end of week call again to remind people. 


3.4.2 Minimal Cost Method 


The minimal cost method consists of a one day 
trip diary kept by all members of households 
selected from amongst those previously 
interviewed by telephone. The following 
procedure would be employed. 


ie) 


2) 


3) 


4) 


If telephone survey indicates a type of 
household which is needed for stratified 
sample, mail out the appropriate number of 
diaries together with an official letter 
thanking them for cooperation in telephone 
survey and soliciting further assistance 
in this special follow-up survey. 


Telephone call the night before the 
designated trip diary day to remind people 
to begin recording trips. 


Telephone call the day after the 
designated day to remind people to mail it 
in. 


If diaries not received by fifth day after 
“diary day", call again to remind people. 


Advance Letters 


The Contractor will be responsible for arranging the 
printing and mailing or personalized letters and the 
correct number of trip diary forms to each selected 
household on a daily basis approximately one week in 
advance of the survey. 


The specific contents of the letter and any other 
accompanying material will be determined by the 
TATPDCSC. 


Interviewing Languages 


The....Contractor, will».be .,expected to complete 
interviews in other languages in addition to 
English. The TATPDCSC will provide official 
translations of the questionnaire in the nine 
languages listed below; the Contractor is expected 
to be able to make telephone calls in these 
languages. 


Italian German French 
Portuguese Greek Polish 
Spanish Cantonese Ukrainian 


The languages are subject to change as the Survey 
proceeds and conditions warrant. The TATPDCSC will 
provide any new translations which may be required. 


Rates of Pay 


The TATPDCSC is concerned about the quality of staff 
and the turnover in staff (particularly telephone 
staff) who will be employed by the Contractor to 
Carry out the Survey. The rates of pay and any 
incentive plan will have a bearing on a Contractor's 
ability to attract and retain good personnel. 


It is. a requirement that the proposed rates be 
listed in the proposal. Any incentive plan for 
minimizing turnover should be described in the 
proposal. 


Staff Training 


TATPDCSC personnel are to be given a minimum of four 
hours during the training process to instruct the 
Survey staff on the purpose of the Survey, the 
unique characteristics of conducting an Origin- 
Destination Travel Survey, and how to deal with a 
range of possible travel situations. The Contractor 
would be responsible for other aspects of the 
training, including instructions on administrative 
procedures, general instructions on dealing with the 
DUDILIC Bec c. 


TATPDCSC personnel will have the right to reject any 
of the staff after the training program. 


Transfer of Questionnaire to Electronic Medium 


All interview data must be transferred onto an 
electronic medium suitable for computerized checking 
and processing. It will be nécessary to arrange for 
the questionnaires to be keyed in as they are 
returned. 


Checking, Correcting, and Coding 


The questionnaire will be designed to be as self- 
coding as possible, but as a_e self-administered 
instrument, each returned form will need to be 
Checked, corrected and coded. Some cases will 
require telephone calls to clarify the data. 


With respect to coding origins, destinations, and 
transfer points, the Contractor will be responsible 
for ensuring that valid, legible addresses are 
recorded in the diary. TheP"TATPDESE’ will be 
responsible for the coding of this information. 


The TATPDCSC expects to employ a computerized 
geocoding technique based on StatsCan's Area Master 
Files. The TATPDCSC will develop and provide the 
software; the Contractor will run the software at 
the same time as the automated checking routines. 


The TATPDCSC will provide the software with the 
logic checks to be applied to the completed 
questionnaires. The Contractor's staff will run the 
checking routines, review the results, make any 
corrections which can be deduced, and make any call 
backs that may be necessary. 


Summaries of the results of the checking are to be 
provided to the TATPDCSC on ae weekly basis. 
TATPDCSC personnel will review problem areas with 
the Contractor and agree on whatever corrective 
action may be necessary. 


Callback Standards 


A minimum of three attempts will be made to contact 
every household at each stage. Busy Signals are not 
to be included as one of the three attempts. In the 
case of no answer, the calls must be at least one 
hour apart. 


Survey Location 


The Contractor may conduct the Trip Diary Survey 
from one, or more locations, whichever is the most 
cost effective. The cost estimates should include 
potential cost savings, if any, if TATPDCSC agencies 
provide the office space at no rent. 


Final Form of Data 


The survey data is to be delivered throughout the 
Survey periods asmealt, iste ucleanedar completed and 
accepted by the TATPDCSC Quality Control personnnel. 
The data is to be on magnetic tape or disk, ready 
for further computer processing. 


Cost Estimates 


The proposal should include your total itemized 
costs for completed interviews with 2,500 and 5,000 
households by the preferred method and by the 
minimal cost method. The costs should be itemized 
by major categories such as wages, computer costs, 
mailing costs, telephone costs, and miscellaneous 
other costs. 


The proposed wage rates and incentives (if any) 
Should be shown separately, together with the 
potential cost savings if TATPDCSC agencies provide 
free office space. 


